Adam Optimization Algorithm  for Wide and Deep Neural Network

Imran Khan Mohd Jais; Amelia Ritahani Ismail; Syed Qamrun Nisa

doi:10.17977/um018v2i12019p41-46

Adam Optimization Algorithm for Wide and Deep Neural Network

Imran Khan Mohd Jais, Amelia Ritahani Ismail, Syed Qamrun Nisa

Abstract

The objective of this research is to evaluate the effects of Adam when used together with a wide and deep neural network. The dataset used was a diagnostic breast cancer dataset taken from UCI Machine Learning. Then, the dataset was fed into a conventional neural network for a benchmark test. Afterwards, the dataset was fed into the wide and deep neural network with and without Adam. It was found that there were improvements in the result of the wide and deep network with Adam. In conclusion, Adam is able to improve the performance of a wide and deep neural network.

Full Text:

PDF

References

H. Cheng et al., “Wide & Deep Learning for Recommender Systems,” in Proceedings of the 1st Workshop on Deep Learning for Recommender Systems, 2016, pp. 7–10.

H. Chougrad and H. Zouaki, “Deep Convolutional Neural Networks for Breast Cancer Screening,” Comput. Methods Programs Biomed., vol. 157, pp. 19–30, 2018.

T. Araújo et al., “Classification of breast cancer histology images using convolutional neural networks,” PLoS One, vol. 12, no. 6, 2017.

D. P. Kingma and J. L. Ba, “ADAM: a method for stochastic optimization,” in Proceedings of the 3rd International Conference on Learning Representations (ICLR 2015), 2015, pp. 1–15.

Q. Li, B. Feng, L. Xie, P. Liang, H. Zhang, and T. Wang, “A Cross-Modality Learning Approach for Vessel Segmentation in Retinal Images,” IEEE Trans. Med. Imaging, vol. 35, no. 1, pp. 109–118.

I. M. Azpiazu, N. Dragovic, O. Anuyah, and M. S. Pera, “Looking for the Movie Seven or Sven from the Movie Frozen ? A Multi-perspective Strategy for Recommending Queries for Children,” in Proceedings of the 2018 Conference on Human Information Interaction & Retrieval, 2018, pp. 92–101.

W. Liu, Z. Wang, X. Liu, N. Zeng, Y. Liu, and F. E. Alsaadi, “A Survey of Deep Neural Network Architectures and Their Applications,” Neurocomputing, vol. 234, pp. 11–26, 2017.

I. Safran and O. Shamir, “On the Quality of the Initial Basin in Overspecified Neural Networks,” in International Conference on Machine Learning, 2016, vol. 774–782.

W. H. Wolberg and O. L. Street, W. Nick Mangasarian, “Breast Cancer Wisconsin (Diagnostic) Data Set,” 1995. [Online]. Available: https://archive.ics.uci.edu/ml/datasets/Breast+Cancer+Wisconsin+(Diagnostic).

Google, “Tensorflow,” 2018. [Online]. Available: Https://Github.Com/Tensorflow.

DOI: http://dx.doi.org/10.17977/um018v2i12019p41-46