Neural networks, PyTorch, Large Language Models (LLMs), Embeddings, and RAG Architecture.
From Python data foundations to cutting-edge GenAI: NumPy & Pandas dataframes, Supervised/Unsupervised Learning with Scikit-learn, Neural Networks & Deep Learning with PyTorch, LLM APIs, Vector Embeddings, Vector Databases (pgvector, Pinecone), and Retrieval-Augmented Generation (RAG).
AI vs ML vs Deep Learning vs GenAI, datasets, training/test splits, and loss functions.
NumPy vectorized n-dimensional arrays, matrix math, Pandas DataFrames, filtering, and aggregation.
Matplotlib plotting, Seaborn statistical heatmaps, feature correlations, and outlier detection.
Linear Regression, Logistic Regression, Decision Trees, Random Forests, and Scikit-learn.
K-Means clustering, Principal Component Analysis (PCA) dimensionality reduction, and anomaly detection.
Artificial neurons, Perceptrons, activation functions (ReLU, Sigmoid), forward pass, and backpropagation.
PyTorch Tensors, GPU acceleration (CUDA), torch.nn.Module, loss functions, and Adam optimizer.
Tokenization, self-attention mechanism, transformer architecture (Encoder/Decoder), and BERT vs GPT.
Autoregressive text generation, temperature, top-p sampling, Few-Shot prompting, and Chain-of-Thought (CoT).
Dense vector representations, cosine distance vs dot product, pgvector PostgreSQL extension, and HNSW indexes.
Document ingestion pipelines, chunking strategies, semantic retrieval, context re-ranking, and hallucination reduction.