Intelligent Systems II · TEE · papers

Q1(a) Traditional versus evolutionary optimization [5]

Re-examination · 25 Jun 2024

Actual historical paper ·100 marks attempted /140 offered · Q1 compulsory + any four of Q2–Q7. Source defects and solution assumptions are explicitly identified.

Question. Q1(a) [5 marks · 2024-06-25]

Compare traditional optimization and evolutionary optimization algorithms. Illustrate the basic framework of evolutionary algorithms.

Answer

Optimization searches for a feasible candidate that maximizes or minimizes an objective. Evolutionary algorithms use a population, fitness-based selection and variation inspired by evolution.

AspectTraditional methods (typical examples)Evolutionary methods
Search stateOften one current candidate, e.g. gradient descentUsually a population of candidates
InformationGradient/Hessian in derivative methods; not required by all traditional methodsPrimarily objective/fitness evaluations
VariationA mathematically derived step or deterministic search ruleCrossover and mutation with stochastic choices
LandscapeStrong efficiency/guarantees possible under assumptions such as convexityUseful for discrete, non-smooth, mixed or multimodal search
GuaranteeDepends on the algorithm and assumptionsNo general finite-run global-optimum guarantee
CostMay require fewer evaluations on suitable smooth problemsOften needs many evaluations and parameter tuning

Framework: encode candidates → initialize feasible population → evaluate fitness → select parents → crossover → mutate → evaluate offspring → choose survivors → repeat until stopping criterion → return best observed candidate.

For example, in a delivery-route GA a chromosome is a permutation of cities; fitness can be inverse route length. Shorter valid tours are favored. A swap mutation preserves city uniqueness. Selection exploits good candidates, while variation introduces exploration. Do not claim every traditional method requires derivatives or every evolutionary method escapes all local optima.