A Brief History of Machine Learning and Artificial Intelligence

Artificial Intelligence (AI) can be categorized into machine learning, soft computing (computational intelligence), and application of AI in various fields such as image processing, computer vision, signal processing, etc. Machine learning itself is categorized into statistical machine learning and deep learning. Soft computing contains fuzzy logic and metaheuristic optimization (intelligent search). The tasks of machine learning are classification, regression (prediction), clustering, reinforcement learning, feature engineering, and numerosity processing. Feature engineering is broken down into feature extraction (dimensionality reduction and manifold learning) and feature selection. Numerosity processing includes outlier detection (anomaly detection) and prototype selection/generation. This article first discusses the categories of AI and tasks of machine learning. Then, it reviews the history of AI, statistical machine learning, and deep learning.