The investigation of gradient method namely Steepest Descent and extending of Barzilai Borwein for solving unconstrained optimization problem / Nur Intan Syahirah Ismail & Nur Atikah Aziz
Steepest Descent is one of the pioneers method in solving optimization problem since it is globally convergence. Even though it is globally convergence, the convergence rate is still slow. Thus, in this project we focusing more on SD method and its modification, to get the better convergence rate. T...
Saved in:
Main Authors: | , |
---|---|
Format: | Thesis |
Language: | English |
Published: |
2019
|
Subjects: | |
Online Access: | http://ir.uitm.edu.my/id/eprint/38918/1/38918.pdf http://ir.uitm.edu.my/id/eprint/38918/ |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
id |
my.uitm.ir.38918 |
---|---|
record_format |
eprints |
spelling |
my.uitm.ir.389182020-12-09T03:39:37Z http://ir.uitm.edu.my/id/eprint/38918/ The investigation of gradient method namely Steepest Descent and extending of Barzilai Borwein for solving unconstrained optimization problem / Nur Intan Syahirah Ismail & Nur Atikah Aziz Ismail, Nur Intan Syahirah Aziz, Nur Atikah Mathematical statistics. Probabilities Analytical methods used in the solution of physical problems Programming. Rule-based programming. Backtrack programming Steepest Descent is one of the pioneers method in solving optimization problem since it is globally convergence. Even though it is globally convergence, the convergence rate is still slow. Thus, in this project we focusing more on SD method and its modification, to get the better convergence rate. This research is to investigate the behavior of gradient method namely Steepest Descent (SD), Barzilai Borwein 1(BB1), Barzilai Borwein 2(BB2) and Jaafar Mohamed (JM). This project is to analyse the performance of this four-method based on CPU time and number of iterations, and to show their global convergence. Eight test functions with several initial points from four geometrical quadrants has been chosen to test on SD, BB1, BB2 and JM method. The collected data is determined based on the number of iteration and CPU time by using exact line search. The results also show that all the methods possess global convergence. In order to analyse the best method geometrically, the performance profile by Dolan and Moore is used. Based on this performance profile, the best method will be determined. Lastly, numerical result will be generated from this research as a numerical prove to all the behaviour of the methods listed above. 2019-07 Thesis NonPeerReviewed text en http://ir.uitm.edu.my/id/eprint/38918/1/38918.pdf Ismail, Nur Intan Syahirah and Aziz, Nur Atikah (2019) The investigation of gradient method namely Steepest Descent and extending of Barzilai Borwein for solving unconstrained optimization problem / Nur Intan Syahirah Ismail & Nur Atikah Aziz. Degree thesis, Universiti Teknologi MARA. |
institution |
Universiti Teknologi Mara |
building |
Tun Abdul Razak Library |
collection |
Institutional Repository |
continent |
Asia |
country |
Malaysia |
content_provider |
Universiti Teknologi Mara |
content_source |
UiTM Institutional Repository |
url_provider |
http://ir.uitm.edu.my/ |
language |
English |
topic |
Mathematical statistics. Probabilities Analytical methods used in the solution of physical problems Programming. Rule-based programming. Backtrack programming |
spellingShingle |
Mathematical statistics. Probabilities Analytical methods used in the solution of physical problems Programming. Rule-based programming. Backtrack programming Ismail, Nur Intan Syahirah Aziz, Nur Atikah The investigation of gradient method namely Steepest Descent and extending of Barzilai Borwein for solving unconstrained optimization problem / Nur Intan Syahirah Ismail & Nur Atikah Aziz |
description |
Steepest Descent is one of the pioneers method in solving optimization problem since it is globally convergence. Even though it is globally convergence, the convergence rate is still slow. Thus, in this project we focusing more on SD method and its modification, to get the better convergence rate. This research is to investigate the behavior of gradient method namely Steepest Descent (SD), Barzilai Borwein 1(BB1), Barzilai Borwein 2(BB2) and Jaafar Mohamed (JM). This project is to analyse the performance of this four-method based on CPU time and number of iterations, and to show their global convergence. Eight test functions with several initial points from four geometrical quadrants has been chosen to test on SD, BB1, BB2 and JM method. The collected data is determined based on the number of iteration and CPU time by using exact line search. The results also show that all the methods possess global convergence. In order to analyse the best method geometrically, the performance profile by Dolan and Moore is used. Based on this performance profile, the best method will be determined. Lastly, numerical result will be generated from this research as a numerical prove to all the behaviour of the methods listed above. |
format |
Thesis |
author |
Ismail, Nur Intan Syahirah Aziz, Nur Atikah |
author_facet |
Ismail, Nur Intan Syahirah Aziz, Nur Atikah |
author_sort |
Ismail, Nur Intan Syahirah |
title |
The investigation of gradient method namely Steepest Descent and extending of Barzilai Borwein for solving unconstrained optimization problem / Nur Intan Syahirah Ismail & Nur Atikah Aziz |
title_short |
The investigation of gradient method namely Steepest Descent and extending of Barzilai Borwein for solving unconstrained optimization problem / Nur Intan Syahirah Ismail & Nur Atikah Aziz |
title_full |
The investigation of gradient method namely Steepest Descent and extending of Barzilai Borwein for solving unconstrained optimization problem / Nur Intan Syahirah Ismail & Nur Atikah Aziz |
title_fullStr |
The investigation of gradient method namely Steepest Descent and extending of Barzilai Borwein for solving unconstrained optimization problem / Nur Intan Syahirah Ismail & Nur Atikah Aziz |
title_full_unstemmed |
The investigation of gradient method namely Steepest Descent and extending of Barzilai Borwein for solving unconstrained optimization problem / Nur Intan Syahirah Ismail & Nur Atikah Aziz |
title_sort |
investigation of gradient method namely steepest descent and extending of barzilai borwein for solving unconstrained optimization problem / nur intan syahirah ismail & nur atikah aziz |
publishDate |
2019 |
url |
http://ir.uitm.edu.my/id/eprint/38918/1/38918.pdf http://ir.uitm.edu.my/id/eprint/38918/ |
_version_ |
1685651616844218368 |
score |
13.211869 |