Data Structures

Weekday Plan

Time	Task
1hour	DS (Data Structures) learning
2hours	DS (Data Structures) Coding
1hours	Workout
2hours	Python+ML
1 and 1/2 hour	Pyspark -> Airflow
1 and 1/2	AWS - > ORACLE
3 hours	Work + lunch
2hours	Java+Spring
1hour	SQL -> MongoDB
1hour	Docker -> Kubernetes
2hour	Frontend
1hour	Kafka -> redis
5hour	Sleep

Weekend Plan

Time	Task
3hours	Apptitude - Math
3hours	OS - DBMS
3hours	ALG0 - DS
3hours	CN - COA
3hours	DM - DLD

⏳ Countdown Timer

Set minutes:

25:00

Design Pattern Youtube Excel Sheets Tables

LLM Developer

Domain	Concept
Mathematics	Linear Algebra: Vectors, Matrices, Matrix Multiplication, Eigenvalues/Eigenvectors
Mathematics	Calculus: Derivatives, Gradients, Partial Derivatives, Chain Rule
Mathematics	Probability: Conditional Probability, Bayes Theorem, Random Variables, Distributions
Mathematics	Statistics: Mean, Median, Variance, Standard Deviation, Hypothesis Testing, p-values
Python Programming	Data Structures: Lists, Dictionaries, Sets, Tuples
Python Programming	Functions, Loops, Conditionals
Python Programming	OOP (Classes, Objects, Inheritance)
Python Programming	File Handling, Exception Handling
Python Programming	Modules & Packages
Python Programming	NumPy, Pandas, Matplotlib, Seaborn (for data analysis and visualization)
Data Preprocessing	Data Cleaning: Handling Missing Data, Duplicates
Data Preprocessing	Feature Engineering: Scaling, Encoding, Binning
Data Preprocessing	Outlier Detection and Removal
Data Preprocessing	Train/Test Split, Cross Validation
Machine Learning	Supervised Learning: Linear Regression, Logistic Regression
Machine Learning	Classification: Decision Trees, Random Forest, SVM, KNN
Machine Learning	Unsupervised Learning: K-Means, DBSCAN, PCA
Machine Learning	Model Evaluation Metrics: Accuracy, Precision, Recall, F1-score, ROC-AUC
Machine Learning	Bias-Variance Tradeoff, Overfitting vs Underfitting
Deep Learning	Neural Networks: Perceptron, Feedforward, Backpropagation
Deep Learning	Activation Functions: Sigmoid, ReLU, Softmax
Deep Learning	Optimization: Gradient Descent, Adam, Learning Rate Scheduling
Deep Learning	Convolutional Neural Networks (CNNs)
Deep Learning	Recurrent Neural Networks (RNNs), LSTMs, GRUs
Natural Language Processing (NLP)	Text Preprocessing: Tokenization, Lemmatization, Stopword Removal
Natural Language Processing (NLP)	Word Embeddings: Word2Vec, GloVe, TF-IDF
Natural Language Processing (NLP)	Sequence Modeling: RNNs, BiRNNs, Attention
Natural Language Processing (NLP)	Transformer Architecture: Self-Attention, Positional Encoding
Natural Language Processing (NLP)	Pretrained Models: BERT, GPT-2, T5
Large Language Models (LLMs)	Architecture of GPT (Transformer, Decoder-only)
Large Language Models (LLMs)	Training Objectives: Causal Language Modeling
Large Language Models (LLMs)	Fine-tuning and Prompt Engineering
Large Language Models (LLMs)	Handling Long Context: RoPE, ALiBi, FlashAttention
Large Language Models (LLMs)	Open Source Models: GPT-2, GPT-J, LLaMA, DeepSeek, Mistral
Tools & Frameworks	PyTorch or TensorFlow
Tools & Frameworks	Hugging Face Transformers Library
Tools & Frameworks	Weights & Biases / TensorBoard for Experiment Tracking
Tools & Frameworks	Docker for Environment Packaging
Tools & Frameworks	Streamlit or Gradio for App Deployment
Advanced Topics	Distributed Training (Data and Model Parallelism)
Advanced Topics	Reinforcement Learning with Human Feedback (RLHF)
Advanced Topics	LoRA, PEFT, QLoRA for Efficient Fine-tuning
Advanced Topics	Quantization, Pruning for Inference Optimization
Advanced Topics	Serving LLMs with vLLM, Triton Inference Server

SQLand Snowflake

Topic	Concept
SQL Basics	What is SQL, RDBMS, Tables, Rows, Columns
DDL	CREATE, ALTER, DROP, TRUNCATE
DML	SELECT, INSERT, UPDATE, DELETE
DCL & TCL	GRANT, REVOKE, COMMIT, ROLLBACK, SAVEPOINT
Data Types	INT, VARCHAR, TEXT, DATE, FLOAT, BOOLEAN, JSON, ARRAY
Constraints	PRIMARY KEY, FOREIGN KEY, UNIQUE, NOT NULL, CHECK, DEFAULT
Joins	INNER, LEFT, RIGHT, FULL OUTER, SELF, CROSS JOINs
Advanced SELECT	WHERE, ORDER BY, DISTINCT, LIMIT, IN, BETWEEN, LIKE
Grouping	GROUP BY, HAVING, Aggregates
Subqueries	Scalar, Correlated, EXISTS, NOT EXISTS
Window Functions	ROW_NUMBER, RANK, DENSE_RANK, NTILE, LEAD, LAG, FIRST_VALUE, LAST_VALUE
CTEs	WITH clauses, Recursive CTEs
Set Operations	UNION, UNION ALL, INTERSECT, EXCEPT
Data Modeling	Normalization, Denormalization, Star & Snowflake Schema, Fact & Dimension Tables
Indexing	B-Tree, Hash, Bitmap, Full-text, Composite Indexes
Performance Tuning	Query plans, EXPLAIN, Optimizations
Views	Views vs Materialized Views
Transactions	ACID, Isolation levels, Deadlocks, MVCC
Stored Procedures & Functions	Stored Procs, Triggers, Functions
JSON & Semi-Structured	JSON types, JSON functions, Arrays
SQL in Big Data	Hive, Spark SQL, BigQuery, Athena, Redshift
Security	Roles, Permissions, Row/Column level security
Date/Time Functions	Timestamp ops, Intervals, Rolling averages
ETL/ELT	MERGE, UPSERT, Data transformation, SCD
Case Studies	Analytics, Reporting, Real-time pipelines
SQL	Introduction to SQL, RDBMS Concepts, Tables, Rows, Columns
DDL	DDL: CREATE, ALTER, DROP, TRUNCATE
DML	DML: SELECT, INSERT, UPDATE, DELETE
DCL & TCL	DCL & TCL: GRANT, REVOKE, COMMIT, ROLLBACK, SAVEPOINT
SQL	SQL Data Types and Constraints
Filtering	Filtering: WHERE, IN, BETWEEN, LIKE, IS NULL
SQL	Sorting, DISTINCT, LIMIT, ALIAS
SQL	INNER JOIN, LEFT JOIN, RIGHT JOIN, FULL JOIN
SQL	SELF JOIN, CROSS JOIN, Multi-table Joins
SQL	GROUP BY and Aggregation Functions
SQL	HAVING Clause vs WHERE
Subqueries	Subqueries: Scalar, Correlated, EXISTS
Set Operations	Set Operations: UNION, INTERSECT, EXCEPT
SQL	Case Studies on Joins and Aggregates
SQL	Introduction to Window Functions, OVER Clause
SQL	ROW_NUMBER, RANK, DENSE_RANK, NTILE
SQL	LEAD, LAG, FIRST_VALUE, LAST_VALUE
SQL	Partition By and Order By in Windows
SQL	Common Table Expressions (CTEs)
SQL	Recursive CTEs
SQL	Real-world Queries using Windows
Data Modeling	Data Modeling: Normalization (1NF to BCNF)
SQL	Denormalization, Star/Snowflake Schema
Indexing	Indexing: B-Tree, Hash, Composite
Query Tuning	Query Tuning: EXPLAIN ANALYZE
SQL	Transactions and Isolation Levels
SQL	Stored Procedures, Triggers, Functions
SQL	Views and Materialized Views
SQL	Working with JSON, Arrays in SQL
SQL on Big Data	SQL on Big Data: Hive, Spark SQL, Redshift
ETL using SQL	ETL using SQL: Merge, Upsert, Data Cleansing
SQL	Slowly Changing Dimensions (SCD Type 1 and 2)
Security	Security: Roles, Permissions, Row-Level Security
SQL	Time Series & Date/Time SQL Functions
SQL	End-to-End Case Study Project
Snowflake	Snowflake Architecture (Cloud Services, Compute, Storage)
Snowflake	Virtual Warehouses
Snowflake	Databases and Schemas in Snowflake
Snowflake	Tables: Permanent, Temporary, and Transient
Snowflake	Data Types in Snowflake
Snowflake	File Formats (CSV, JSON, Parquet)
Snowflake	Stages (Internal, External)
Snowflake	Copy Into and Unload Commands
Snowflake	Querying Semi-Structured Data (VARIANT, OBJECT, ARRAY)
Snowflake	Snowpipe (Continuous Data Ingestion)
Snowflake	Streams and Tasks (Change Data Capture)
Snowflake	Time Travel and Fail-safe
Snowflake	Cloning (Zero-Copy Cloning)
Snowflake	Data Sharing (Secure Data Sharing)
Snowflake	Access Control and Role-Based Security
Snowflake	Warehouse Sizing and Auto Suspend/Resume
Snowflake	Materialized Views
Snowflake	Tasks for Scheduling
Snowflake	Snowflake SQL Functions
Snowflake	Query Profiling and Optimization
Snowflake	Cost Optimization in Snowflake
Snowflake	Integration with BI tools (Power BI, Tableau)
Snowflake	Snowflake with Python (Snowpark and Connector)
Snowflake	Snowflake REST API

System Design

Topic	Concept	Study Resource
Basics of System Design	Scalability, Reliability, Availability, Maintainability, Performance	https://github.com/donnemartin/system-design-primer
Basics of System Design	Latency vs Throughput	https://www.highscalability.com/latency-everywhere-and-it-costs-you-sales-how-crush-it/
Basics of System Design	CAP Theorem	https://www.geeksforgeeks.org/cap-theorem-in-distributed-systems/
Basics of System Design	Load Balancing	https://www.cloudflare.com/learning/performance/what-is-load-balancing/
Basics of System Design	Caching (LRU, TTL, Write-Through, Write-Behind)	https://www.geeksforgeeks.org/cache-memory-in-computer-organization/
Design Patterns & Concepts	Microservices vs Monolith	https://microservices.io/
Design Patterns & Concepts	Service-Oriented Architecture (SOA)	https://www.geeksforgeeks.org/service-oriented-architecture-soa/
Design Patterns & Concepts	Database Sharding & Partitioning	https://www.geeksforgeeks.org/sharding-in-dbms/
Design Patterns & Concepts	Indexes and Query Optimization	https://www.geeksforgeeks.org/indexing-in-databases-set-1/
Design Patterns & Concepts	Rate Limiting & Throttling	https://developer.mozilla.org/en-US/docs/Web/HTTP/Headers/Retry-After
Core Components	API Gateway	https://www.geeksforgeeks.org/api-gateway/
Core Components	CDN (Content Delivery Network)	https://developer.mozilla.org/en-US/docs/Glossary/CDN
Core Components	Message Queues (Kafka, RabbitMQ)	https://geekflare.com/message-queue-brokers/
Core Components	Databases (SQL vs NoSQL)	https://www.mongodb.com/nosql-explained
Core Components	File Storage (S3, Blob Storage)	https://www.freecodecamp.org/news/what-is-amazon-s3/
High-Level Design (HLD)	Design URL Shortener	https://github.com/donnemartin/system-design-primer#design-a-url-shortening-service-like-tinyurl
High-Level Design (HLD)	Design Twitter	https://www.educative.io/courses/grokking-the-system-design-interview/3jzQzZq3rBO
High-Level Design (HLD)	Design YouTube	https://github.com/donnemartin/system-design-primer#design-youtube
High-Level Design (HLD)	Design Netflix	https://netflixtechblog.com/
High-Level Design (HLD)	Design WhatsApp	https://github.com/donnemartin/system-design-primer#design-a-chat-system
Low-Level Design (LLD)	OOP Design Principles (SOLID)	https://medium.com/@cramhead/solid-principles-explained-in-plain-english-67b1246bcdf
Low-Level Design (LLD)	Class Diagrams and Sequence Diagrams	https://www.uml-diagrams.org/class-diagrams-overview.html
Low-Level Design (LLD)	Designing Entities and Services	https://sourcemaking.com/design_patterns
Low-Level Design (LLD)	Common Design Patterns (Factory, Singleton, Strategy)	https://sourcemaking.com/design_patterns
Performance and Scalability	Horizontal vs Vertical Scaling	https://www.scaleway.com/en/docs/compute/instances/tutorials/vertical-vs-horizontal-scaling/
Performance and Scalability	Database Replication	https://www.javatpoint.com/dbms-replication
Performance and Scalability	Eventual Consistency vs Strong Consistency	https://www.geeksforgeeks.org/eventual-consistency-in-dbms/
Performance and Scalability	Monitoring and Logging (ELK Stack, Prometheus)	https://logz.io/blog/what-is-elk-stack/
Performance and Scalability	Failover and Redundancy	https://www.geeksforgeeks.org/fault-tolerance-in-distributed-systems/

SpringBoot Prerequisites

Prerequisite Topic	Concept
Java Core	OOP Concepts
Java Core	Collections
Java Core	Exception Handling
Java Core	File I/O
Java Core	Multithreading
Java Advanced	Generics
Java Advanced	Annotations
Java Advanced	Lambda Expressions
Java Advanced	Streams API
Maven/Gradle	Dependency Management
Maven/Gradle	Build Lifecycle
Basic HTML/CSS/JS	Frontend basics to test APIs
Databases	SQL Basics
Databases	Joins
Databases	Indexes
Version Control	Git Basics
Version Control	Branching and Merging
REST API Concepts	HTTP Methods
REST API Concepts	Status Codes
REST API Concepts	CRUD operations

Spring Boot Topics

Spring Boot Topic	Concept
Project Setup	Spring Initializr
Project Setup	Maven/Gradle Setup
Project Setup	Application Properties
Spring Core	IoC Container
Spring Core	Dependency Injection
Spring Core	Beans and Scopes
Spring Core	Bean Lifecycle
Spring Boot Basics	@SpringBootApplication
Spring Boot Basics	Auto Configuration
Spring Boot Basics	Properties Files
REST APIs	@RestController
REST APIs	@RequestMapping
REST APIs	Request/Response Handling
REST APIs	PathVariable, RequestParam
Data Access	Spring Data JPA
Data Access	Repositories
Data Access	CRUD Operations
Data Access	Custom Queries
Data Access	Pagination/Sorting
Database Integration	MySQL/PostgreSQL Setup
Database Integration	application.yml/properties config
Database Integration	JPA Entities
Exception Handling	@ControllerAdvice
Exception Handling	Custom Exceptions
Exception Handling	Global Error Handling
Validation	@Valid, @NotNull, etc.
Validation	BindingResult
Validation	Custom Validators
Security	Spring Security Basics
Security	JWT Authentication
Security	User Roles & Authorities
Service Layer	@Service
Service Layer	Business Logic Separation
Service Layer	DTOs and Mappers
Testing	Unit Tests (JUnit/Mockito)
Testing	Integration Tests
Testing	TestRestTemplate
Logging	SLF4J/Logback
Logging	Application Logging
Logging	Log Levels
Actuator	Monitoring
Actuator	Health Checks
Actuator	Metrics
Swagger/OpenAPI	API Documentation
Swagger/OpenAPI	Annotations
Swagger/OpenAPI	UI Testing
Scheduling	@Scheduled
Scheduling	Cron Jobs
Scheduling	Async Methods
Messaging	Kafka Integration
Messaging	RabbitMQ Basics
Messaging	Message Listeners
File Handling	File Upload/Download
File Handling	Storing in File System/DB
Caching	@Cacheable
Caching	Redis Integration
Email Service	JavaMailSender
Email Service	Templates
Email Service	Async Emails
Deployment	Jar Packaging
Deployment	Dockerizing Spring Boot App
Deployment	CI/CD Basics
Microservices Concepts	Service Discovery (Eureka)
Microservices Concepts	API Gateway (Zuul/Spring Cloud Gateway)
Microservices Concepts	Config Server
Microservices Concepts	Feign Clients
Cloud Integration	Deploy to AWS
Cloud Integration	Use RDS, S3
Cloud Integration	Elastic Beanstalk or ECS

Airflow

Topic	Concept
1. Introduction to Airflow	What is Airflow?
1. Introduction to Airflow	Use Cases of Airflow
1. Introduction to Airflow	Core Concepts Overview (DAGs, Tasks, Operators)
1. Introduction to Airflow	Airflow vs Other Workflow Tools
2. Airflow Architecture	Scheduler
2. Airflow Architecture	Web Server
2. Airflow Architecture	Metadata Database
2. Airflow Architecture	Executor Types (Sequential, Local, Celery, Kubernetes)
2. Airflow Architecture	Workers and Queues
3. Installation and Setup	Installing Airflow with pip or Docker
3. Installation and Setup	Airflow Home Directory Structure
3. Installation and Setup	Initializing the Database
3. Installation and Setup	Starting Scheduler and Web Server
3. Installation and Setup	Using Airflow CLI
4. DAGs (Directed Acyclic Graphs)	Creating a DAG File
4. DAGs (Directed Acyclic Graphs)	DAG Parameters and Default Arguments
4. DAGs (Directed Acyclic Graphs)	Scheduling (Cron, Timetables, '@' Expressions)
4. DAGs (Directed Acyclic Graphs)	DAG Runs and Triggering DAGs
4. DAGs (Directed Acyclic Graphs)	Pausing and Unpausing DAGs
5. Tasks and Operators	PythonOperator, BashOperator, DummyOperator
5. Tasks and Operators	BranchPythonOperator, ShortCircuitOperator
5. Tasks and Operators	EmailOperator, TriggerDagRunOperator
5. Tasks and Operators	Custom Operators
5. Tasks and Operators	Task Decorators and TaskFlow API
6. Task Lifecycle and Execution	Task States (queued, running, success, failed, etc.)
6. Task Lifecycle and Execution	Retries, Timeouts, and SLA
6. Task Lifecycle and Execution	Upstream and Downstream Dependencies
6. Task Lifecycle and Execution	XComs and Data Sharing Between Tasks
6. Task Lifecycle and Execution	Task Logging and Monitoring
7. Airflow Hooks and Connections	Understanding Hooks
7. Airflow Hooks and Connections	Common Hooks (PostgresHook, S3Hook, MySqlHook)
7. Airflow Hooks and Connections	Managing Connections in UI and CLI
7. Airflow Hooks and Connections	Secrets Backend Integration
8. Airflow Variables and Macros	Defining and Using Variables
8. Airflow Variables and Macros	Built-in Macros and Jinja Templates
8. Airflow Variables and Macros	Custom Macros
8. Airflow Variables and Macros	Environment Variables in Airflow
9. Error Handling and Debugging	Task Failure Reasons
9. Error Handling and Debugging	Task Retries and Error Alerts
9. Error Handling and Debugging	Logging Best Practices
9. Error Handling and Debugging	Debugging Locally
10. Monitoring and Alerting	Using the Web UI
10. Monitoring and Alerting	Task and DAG Level Alerts
10. Monitoring and Alerting	Email Alerts and Callbacks
10. Monitoring and Alerting	Integration with Prometheus and Grafana
11. Airflow Plugins and Extensions	Creating Custom Operators and Sensors
11. Airflow Plugins and Extensions	Creating Plugins for UI
11. Airflow Plugins and Extensions	Adding Views and Flask Blueprints
12. Airflow with External Systems	Airflow with AWS (S3, Redshift, EMR)
12. Airflow with External Systems	Airflow with GCP (BigQuery, GCS)
12. Airflow with External Systems	Airflow with Databases (MySQL, Postgres)
12. Airflow with External Systems	Airflow with Apache Spark and Hadoop
13. Testing and CI/CD	Unit Testing DAGs and Tasks
13. Testing and CI/CD	Testing with pytest and mock
13. Testing and CI/CD	CI/CD Integration (GitHub Actions, Jenkins)
13. Testing and CI/CD	Airflow Deployment Strategies
14. Advanced Scheduling and Triggers	Timetables and Custom Schedules
14. Advanced Scheduling and Triggers	Deferrable Operators and Triggers
14. Advanced Scheduling and Triggers	Event-based DAGs
14. Advanced Scheduling and Triggers	Sensor Modes and Soft Failures
15. Airflow in Production	Best Practices for DAG Design
15. Airflow in Production	Production Deployment (Docker, Kubernetes)
15. Airflow in Production	Performance Tuning and Scaling
15. Airflow in Production	Monitoring and Alerting in Production
16. Security and Access Control	User Roles and Permissions (RBAC)
16. Security and Access Control	Web UI Authentication (LDAP, OAuth, etc.)
16. Security and Access Control	Securing Metadata DB and Secrets
16. Security and Access Control	Logging and Audit Trails

AWS

Topic	Service	Key Concepts	Top boto3 Libraries
1. Compute Services	Amazon EC2	Instance types, AMIs, Auto Scaling, Elastic IPs	boto3.ec2
1. Compute Services	AWS Lambda	Function creation, Triggers, Event-driven computing	boto3.lambda
1. Compute Services	Amazon ECS/EKS	Container orchestration, Fargate, Cluster management	boto3.ecs, boto3.eks
2. Storage Services	Amazon S3	Buckets, Object storage, Lifecycle policies	boto3.s3
2. Storage Services	Amazon EBS	Block storage volumes, Snapshots, Volume types	boto3.ebs
2. Storage Services	Amazon EFS	File systems, Mount targets, Shared access	boto3.efs
3. Networking and Content Delivery	Amazon VPC	Subnets, Route tables, NAT gateways, Internet gateways	boto3.ec2
3. Networking and Content Delivery	Amazon CloudFront	CDN setup, Distributions, Caching strategies	boto3.cloudfront
3. Networking and Content Delivery	Elastic Load Balancing	ALB/NLB/CLB types, Target groups, Health checks	boto3.elb
4. Databases	Amazon RDS	Multi-AZ, Read replicas, Backups	boto3.rds
4. Databases	Amazon DynamoDB	NoSQL database, Partitions, Streams	boto3.dynamodb
4. Databases	Amazon Aurora	MySQL/PostgreSQL compatibility, Performance tuning	boto3.rds
5. Security, Identity, and Compliance	IAM	Users, Roles, Policies, MFA	boto3.iam
5. Security, Identity, and Compliance	AWS KMS	Key management, Encryption, Key rotation	boto3.kms
5. Security, Identity, and Compliance	AWS Shield & WAF	DDoS protection, Rules, Web ACLs	boto3.waf
6. Management and Governance	CloudWatch	Metrics, Logs, Alarms, Dashboards	boto3.cloudwatch
6. Management and Governance	CloudTrail	Event history, Compliance, Insights	boto3.cloudtrail
6. Management and Governance	AWS Config	Resource inventory, Change history, Compliance auditing	boto3.config
7. Developer Tools	CodeCommit	Git repositories, Version control	boto3.codecommit
7. Developer Tools	CodePipeline	CI/CD pipelines, Integration stages	boto3.codepipeline
7. Developer Tools	CodeBuild	Build environments, Artifacts, Integration	boto3.codebuild
8. Analytics	Amazon Athena	Querying S3 data using SQL	boto3.athena
8. Analytics	Amazon EMR	Big data processing, Hadoop, Spark	boto3.emr
8. Analytics	Amazon Kinesis	Real-time data streaming, Firehose, Analytics	boto3.kinesis
9. Machine Learning	Amazon SageMaker	Model building, Training, Deployment	boto3.sagemaker
9. Machine Learning	AWS Rekognition	Image and video analysis	boto3.rekognition
9. Machine Learning	Comprehend & Translate	Text analytics, Language translation	boto3.comprehend, boto3.translate
10. Migration and Transfer	AWS DMS	Database migration service, Schema conversion	boto3.dms
10. Migration and Transfer	Snowball & Snowmobile	Physical data transfer appliances	boto3.snowball
10. Migration and Transfer	AWS Transfer Family	SFTP, FTPS support for S3	boto3.transfer

Kafka

Topic	Concept
1. Introduction to Kafka	What is Kafka?
1. Introduction to Kafka	Kafka Use Cases
1. Introduction to Kafka	Kafka vs Traditional Messaging Systems
1. Introduction to Kafka	Core Concepts Overview (Producer, Consumer, Broker, Topic)
2. Kafka Architecture	Kafka Cluster Architecture
2. Kafka Architecture	Brokers and Topics
2. Kafka Architecture	Partitions and Offsets
2. Kafka Architecture	Replication and In-Sync Replicas (ISR)
2. Kafka Architecture	Leaders and Followers
2. Kafka Architecture	ZooKeeper vs KRaft (Kafka Raft Metadata Mode)
3. Kafka Installation and Setup	Installing Kafka and ZooKeeper
3. Kafka Installation and Setup	Single-node vs Multi-node Setup
3. Kafka Installation and Setup	Kafka Configuration Files
3. Kafka Installation and Setup	Starting Kafka and ZooKeeper Services
3. Kafka Installation and Setup	Basic CLI Tools (kafka-topics, kafka-console-producer, kafka-console-consumer)
4. Producers	Producer API
4. Producers	Producer Configurations
4. Producers	Serialization and Custom Serializers
4. Producers	Partitioning Strategies
4. Producers	Message Acknowledgment and Delivery Semantics (At most once, At least once, Exactly once)
4. Producers	Error Handling and Retries
5. Consumers	Consumer API
5. Consumers	Consumer Groups and Load Balancing
5. Consumers	Consumer Offset Management
5. Consumers	Manual vs Automatic Offset Commit
5. Consumers	Deserialization and Custom Deserializers
5. Consumers	Rebalancing and Sticky Partitions
6. Kafka Topics and Partitions	Creating and Configuring Topics
6. Kafka Topics and Partitions	Retention Policies
6. Kafka Topics and Partitions	Log Segmentation and Compaction
6. Kafka Topics and Partitions	Topic Configuration Parameters
6. Kafka Topics and Partitions	Viewing Topic Details (CLI and Admin API)
7. Kafka Streams	Introduction to Kafka Streams
7. Kafka Streams	Stream Processing Concepts (KStream, KTable)
7. Kafka Streams	Stateless vs Stateful Transformations
7. Kafka Streams	Windowing and Joins
7. Kafka Streams	Error Handling and Fault Tolerance
7. Kafka Streams	Interactive Queries
8. Kafka Connect	Kafka Connect Architecture
8. Kafka Connect	Source and Sink Connectors
8. Kafka Connect	Standalone vs Distributed Mode
8. Kafka Connect	Creating and Running Connectors
8. Kafka Connect	Transformations in Kafka Connect
8. Kafka Connect	Connector Configuration and Monitoring
9. Kafka Security	Authentication (SSL/SASL)
9. Kafka Security	Authorization (ACLs)
9. Kafka Security	Encryption (TLS)
9. Kafka Security	Kafka Security Configuration
9. Kafka Security	Integrating with External Authentication Systems (e.g., Kerberos, LDAP)
10. Monitoring and Management	Monitoring Kafka Metrics (JMX, Prometheus, Grafana)
10. Monitoring and Management	Kafka Manager Tools
10. Monitoring and Management	Logging and Auditing
10. Monitoring and Management	Quotas and Throttling
10. Monitoring and Management	Detecting and Handling Failures
11. Performance Tuning	Producer and Consumer Tuning
11. Performance Tuning	Broker Tuning Parameters
11. Performance Tuning	Batching, Compression, and Linger.ms
11. Performance Tuning	Disk and Network Considerations
11. Performance Tuning	Garbage Collection Tuning
12. Kafka in Production	Capacity Planning
12. Kafka in Production	Backup and Recovery
12. Kafka in Production	Rolling Upgrades and Downgrades
12. Kafka in Production	Disaster Recovery and Multi-DC Setup
12. Kafka in Production	Zero Downtime Deployments
13. Advanced Kafka	Kafka Internals (Storage, Log Cleaner, Thread Model)
13. Advanced Kafka	Kafka KRaft Mode (No ZooKeeper)
13. Advanced Kafka	Kafka Transaction API
13. Advanced Kafka	Exactly Once Semantics (EOS)
13. Advanced Kafka	Tiered Storage (KIP-405)
14. Kafka with Other Technologies	Kafka with Spark, Flink, and Storm
14. Kafka with Other Technologies	Kafka Integration with Hadoop and HDFS
14. Kafka with Other Technologies	Kafka and Databases (Debezium, CDC)
14. Kafka with Other Technologies	Kafka with REST Proxy and Schema Registry
14. Kafka with Other Technologies	Kafka and Kubernetes Deployment

PySpark

Topic	Concept
1. Introduction to PySpark	What is PySpark?
1. Introduction to PySpark	Spark vs Hadoop
1. Introduction to PySpark	Components of Apache Spark
1. Introduction to PySpark	Spark Architecture Overview
1. Introduction to PySpark	PySpark Installation & Setup
1. Introduction to PySpark	Running PySpark Shell
2. RDD (Resilient Distributed Dataset)	Creating RDDs
2. RDD (Resilient Distributed Dataset)	RDD Operations: Transformations and Actions
2. RDD (Resilient Distributed Dataset)	RDD Persistence and Caching
2. RDD (Resilient Distributed Dataset)	RDD Lineage and DAG
2. RDD (Resilient Distributed Dataset)	Passing functions to Spark
2. RDD (Resilient Distributed Dataset)	Working with Key-Value RDDs
3. DataFrames and Datasets	Creating DataFrames
3. DataFrames and Datasets	Schema Definition and Inference
3. DataFrames and Datasets	DataFrame Operations (select, filter, groupBy, etc.)
3. DataFrames and Datasets	DataFrame vs RDD
3. DataFrames and Datasets	Working with Columns and Expressions
3. DataFrames and Datasets	DataFrame Caching and Persistence
4. PySpark SQL	SparkSession and SparkContext
4. PySpark SQL	Running SQL Queries
4. PySpark SQL	Using Temporary and Global Views
4. PySpark SQL	Reading and Writing Data (CSV, JSON, Parquet, etc.)
4. PySpark SQL	DataFrame to SQL and vice versa
4. PySpark SQL	UDFs (User Defined Functions)
5. Data Sources and File Formats	Working with CSV, JSON, Parquet, ORC, Avro
5. Data Sources and File Formats	Reading and Writing from Databases (JDBC)
5. Data Sources and File Formats	Partitioning and Bucketing
5. Data Sources and File Formats	Handling corrupt and missing data
6. Spark Streaming (Structured Streaming)	Basics of Structured Streaming
6. Spark Streaming (Structured Streaming)	Streaming Sources and Sinks
6. Spark Streaming (Structured Streaming)	Windowed Operations
6. Spark Streaming (Structured Streaming)	Watermarking
6. Spark Streaming (Structured Streaming)	Stateful vs Stateless Operations
6. Spark Streaming (Structured Streaming)	Handling Late Data
7. PySpark MLlib (Machine Learning)	Overview of MLlib
7. PySpark MLlib (Machine Learning)	Data Preprocessing (StringIndexer, VectorAssembler, etc.)
7. PySpark MLlib (Machine Learning)	Feature Engineering
7. PySpark MLlib (Machine Learning)	Supervised Learning (Classification, Regression)
7. PySpark MLlib (Machine Learning)	Unsupervised Learning (Clustering)
7. PySpark MLlib (Machine Learning)	Model Evaluation and Tuning (CrossValidator, ParamGridBuilder)
8. PySpark GraphX (Graph Processing with GraphFrames)	Creating GraphFrames
8. PySpark GraphX (Graph Processing with GraphFrames)	Basic Graph Algorithms (PageRank, BFS, etc.)
8. PySpark GraphX (Graph Processing with GraphFrames)	Motif Finding
8. PySpark GraphX (Graph Processing with GraphFrames)	Working with Vertices and Edges
9. Performance Tuning and Optimization	Spark Configurations and Parameters
9. Performance Tuning and Optimization	Broadcast Variables and Accumulators
9. Performance Tuning and Optimization	Caching and Persistence Strategies
9. Performance Tuning and Optimization	Partitioning Strategies
9. Performance Tuning and Optimization	Skew Handling
9. Performance Tuning and Optimization	Monitoring and Debugging (Spark UI)
10. Deployment and Cluster Management	Standalone, YARN, Mesos, Kubernetes
10. Deployment and Cluster Management	Submitting PySpark Jobs
10. Deployment and Cluster Management	Packaging Applications with spark-submit
10. Deployment and Cluster Management	Configuring Executors and Driver
10. Deployment and Cluster Management	Handling Logs and Errors
11. Advanced Topics	Custom Partitioners
11. Advanced Topics	Advanced UDFs and Pandas UDFs
11. Advanced Topics	Delta Lake and ACID Transactions
11. Advanced Topics	Lakehouse Architecture
11. Advanced Topics	Integration with Hive and HDFS
11. Advanced Topics	Columnar Storage and Catalyst Optimizer
12. Testing and Best Practices	Unit Testing with PySpark
12. Testing and Best Practices	Test Data Generation
12. Testing and Best Practices	Code Modularization
12. Testing and Best Practices	Logging and Monitoring
12. Testing and Best Practices	Version Control and CI/CD

PySpark - Expert-Level Additions

Expert-Level Area	Key Focus Points
End-to-End Project Mastery	Build complex batch and streaming pipelines with ML components
Open-Source Contribution	Contribute to Spark or PySpark GitHub repos or JIRA
System Design	Architect scalable, cost-efficient, and fault-tolerant data systems
Performance Profiling	Understand task serialization, avoid shuffles, analyze Spark UI
Integration with Ecosystem	Work with Kafka, Airflow, Elasticsearch, Snowflake, etc.
Cloud Platform Expertise	Deploy Spark jobs on AWS Glue, EMR, Databricks, or GCP Dataproc
Debugging Spark Jobs	Diagnose skew, spill, GC issues using Spark UI and logs
Advanced Spark Internals	Read and understand Catalyst and Tungsten internals
Kubernetes-based Spark	Use native Spark on Kubernetes with proper config and tuning
Soft Skills and Leadership	Mentor others, write docs, communicate design trade-offs

frontend

Step	Main Topic	Subtopics / Concepts	Why Important	Done ✅
1	HTML Basics	HTML Boilerplate	Fundamental building blocks for structuring any web page.	NaN
1	HTML Basics	Doctype	Fundamental building blocks for structuring any web page.	NaN
1	HTML Basics	HTML Structure	Fundamental building blocks for structuring any web page.	NaN
1	HTML Basics	Head vs Body	Fundamental building blocks for structuring any web page.	NaN
1	HTML Basics	Meta Tags	Fundamental building blocks for structuring any web page.	NaN
1	HTML Basics	Semantic Tags	Fundamental building blocks for structuring any web page.	NaN
1	HTML Basics	Text Elements	Fundamental building blocks for structuring any web page.	NaN
1	HTML Basics	Links and Anchors	Fundamental building blocks for structuring any web page.	NaN
1	HTML Basics	Lists (ul, ol)	Fundamental building blocks for structuring any web page.	NaN
1	HTML Basics	Tables	Fundamental building blocks for structuring any web page.	NaN
1	HTML Basics	Forms and Inputs	Fundamental building blocks for structuring any web page.	NaN
1	HTML Basics	iFrames	Fundamental building blocks for structuring any web page.	NaN
1	HTML Basics	Entities	Fundamental building blocks for structuring any web page.	NaN
1	HTML Basics	Canvas	Fundamental building blocks for structuring any web page.	NaN
1	HTML Basics	SVG	Fundamental building blocks for structuring any web page.	NaN
1	HTML Basics	Accessibility (ARIA roles)	Fundamental building blocks for structuring any web page.	NaN
1	HTML Basics	SEO Basics	Fundamental building blocks for structuring any web page.	NaN
2	CSS Fundamentals	CSS Syntax	Enables styling, layout, and responsive design across devices.	NaN
2	CSS Fundamentals	Selectors	Enables styling, layout, and responsive design across devices.	NaN
2	CSS Fundamentals	Colors & Units	Enables styling, layout, and responsive design across devices.	NaN
2	CSS Fundamentals	Typography	Enables styling, layout, and responsive design across devices.	NaN
2	CSS Fundamentals	Box Model	Enables styling, layout, and responsive design across devices.	NaN
2	CSS Fundamentals	Margin, Padding, Border	Enables styling, layout, and responsive design across devices.	NaN
2	CSS Fundamentals	Display Property	Enables styling, layout, and responsive design across devices.	NaN
2	CSS Fundamentals	Visibility & Overflow	Enables styling, layout, and responsive design across devices.	NaN
2	CSS Fundamentals	Positioning	Enables styling, layout, and responsive design across devices.	NaN
2	CSS Fundamentals	Z-index	Enables styling, layout, and responsive design across devices.	NaN
2	CSS Fundamentals	Flexbox	Enables styling, layout, and responsive design across devices.	NaN
2	CSS Fundamentals	Grid	Enables styling, layout, and responsive design across devices.	NaN
2	CSS Fundamentals	Pseudo-classes	Enables styling, layout, and responsive design across devices.	NaN
2	CSS Fundamentals	Pseudo-elements	Enables styling, layout, and responsive design across devices.	NaN
2	CSS Fundamentals	Transitions	Enables styling, layout, and responsive design across devices.	NaN
2	CSS Fundamentals	Animations	Enables styling, layout, and responsive design across devices.	NaN
2	CSS Fundamentals	Responsive Design	Enables styling, layout, and responsive design across devices.	NaN
2	CSS Fundamentals	Media Queries	Enables styling, layout, and responsive design across devices.	NaN
2	CSS Fundamentals	Dark/Light Mode Styling	Enables styling, layout, and responsive design across devices.	NaN
2	CSS Fundamentals	CSS Variables	Enables styling, layout, and responsive design across devices.	NaN
3	JavaScript Essentials	Variables (let, const, var)	Adds interactivity and logic to the frontend.	NaN
3	JavaScript Essentials	Data Types	Adds interactivity and logic to the frontend.	NaN
3	JavaScript Essentials	Operators	Adds interactivity and logic to the frontend.	NaN
3	JavaScript Essentials	Conditional Statements	Adds interactivity and logic to the frontend.	NaN
3	JavaScript Essentials	Loops	Adds interactivity and logic to the frontend.	NaN
3	JavaScript Essentials	Functions & Arrow Functions	Adds interactivity and logic to the frontend.	NaN
3	JavaScript Essentials	Scope & Hoisting	Adds interactivity and logic to the frontend.	NaN
3	JavaScript Essentials	Closures	Adds interactivity and logic to the frontend.	NaN
3	JavaScript Essentials	Objects & Arrays	Adds interactivity and logic to the frontend.	NaN
3	JavaScript Essentials	Object & Array Methods	Adds interactivity and logic to the frontend.	NaN
3	JavaScript Essentials	ES6+ Features	Adds interactivity and logic to the frontend.	NaN
3	JavaScript Essentials	DOM Manipulation	Adds interactivity and logic to the frontend.	NaN
3	JavaScript Essentials	Event Handling	Adds interactivity and logic to the frontend.	NaN
3	JavaScript Essentials	JSON	Adds interactivity and logic to the frontend.	NaN
3	JavaScript Essentials	Error Handling	Adds interactivity and logic to the frontend.	NaN
3	JavaScript Essentials	Timers	Adds interactivity and logic to the frontend.	NaN
3	JavaScript Essentials	Functional Programming Basics	Adds interactivity and logic to the frontend.	NaN
4	Advanced JavaScript	Asynchronous JS (callbacks, promises, async/await)	Handles data, user input, and performance optimization.	NaN
4	Advanced JavaScript	Fetch API	Handles data, user input, and performance optimization.	NaN
4	Advanced JavaScript	Modules (import/export)	Handles data, user input, and performance optimization.	NaN
4	Advanced JavaScript	LocalStorage & SessionStorage	Handles data, user input, and performance optimization.	NaN
4	Advanced JavaScript	Cookies	Handles data, user input, and performance optimization.	NaN
4	Advanced JavaScript	Debouncing & Throttling	Handles data, user input, and performance optimization.	NaN
5	Git & GitHub	Git Basics	Essential for tracking changes and collaboration.	NaN
5	Git & GitHub	Cloning Repos	Essential for tracking changes and collaboration.	NaN
5	Git & GitHub	Staging/Committing	Essential for tracking changes and collaboration.	NaN
5	Git & GitHub	Branches	Essential for tracking changes and collaboration.	NaN
5	Git & GitHub	Merging	Essential for tracking changes and collaboration.	NaN
5	Git & GitHub	Pull Requests	Essential for tracking changes and collaboration.	NaN
5	Git & GitHub	Reverting/Resetting	Essential for tracking changes and collaboration.	NaN
5	Git & GitHub	Using GitHub	Essential for tracking changes and collaboration.	NaN
6	React Basics	JSX	Modern way to build modular and interactive UIs.	NaN
6	React Basics	Functional Components	Modern way to build modular and interactive UIs.	NaN
6	React Basics	Props	Modern way to build modular and interactive UIs.	NaN
6	React Basics	State	Modern way to build modular and interactive UIs.	NaN
6	React Basics	Events	Modern way to build modular and interactive UIs.	NaN
6	React Basics	Conditional Rendering	Modern way to build modular and interactive UIs.	NaN
6	React Basics	Lists and Keys	Modern way to build modular and interactive UIs.	NaN
6	React Basics	Forms	Modern way to build modular and interactive UIs.	NaN
6	React Basics	useState	Modern way to build modular and interactive UIs.	NaN
6	React Basics	useEffect	Modern way to build modular and interactive UIs.	NaN
6	React Basics	React Router	Modern way to build modular and interactive UIs.	NaN
7	React Advanced	Lifting State Up	Handles larger apps and complex state efficiently.	NaN
7	React Advanced	Context API	Handles larger apps and complex state efficiently.	NaN
7	React Advanced	Refs and useRef	Handles larger apps and complex state efficiently.	NaN
7	React Advanced	useReducer	Handles larger apps and complex state efficiently.	NaN
7	React Advanced	useMemo	Handles larger apps and complex state efficiently.	NaN
7	React Advanced	useCallback	Handles larger apps and complex state efficiently.	NaN
7	React Advanced	React.memo	Handles larger apps and complex state efficiently.	NaN
7	React Advanced	Code Splitting	Handles larger apps and complex state efficiently.	NaN
7	React Advanced	Lazy Loading	Handles larger apps and complex state efficiently.	NaN
7	React Advanced	Error Boundaries	Handles larger apps and complex state efficiently.	NaN
7	React Advanced	Portals	Handles larger apps and complex state efficiently.	NaN
7	React Advanced	Custom Hooks	Handles larger apps and complex state efficiently.	NaN
7	React Advanced	React Query / TanStack Query	Handles larger apps and complex state efficiently.	NaN
8	Component Styling	CSS Modules	Improves productivity and visual polish of apps.	NaN
8	Component Styling	Styled Components	Improves productivity and visual polish of apps.	NaN
8	Component Styling	Tailwind CSS	Improves productivity and visual polish of apps.	NaN
8	Component Styling	Framer Motion	Improves productivity and visual polish of apps.	NaN
8	Component Styling	Dark Mode	Improves productivity and visual polish of apps.	NaN
8	Component Styling	Reusable UI Components	Improves productivity and visual polish of apps.	NaN
9	Advanced Project Skills	WebSockets	Enables real-time, secure, and media-intensive app capabilities.	NaN
9	Advanced Project Skills	Socket.IO	Enables real-time, secure, and media-intensive app capabilities.	NaN
9	Advanced Project Skills	Firebase Realtime DB	Enables real-time, secure, and media-intensive app capabilities.	NaN
9	Advanced Project Skills	JWT Authentication	Enables real-time, secure, and media-intensive app capabilities.	NaN
9	Advanced Project Skills	OAuth	Enables real-time, secure, and media-intensive app capabilities.	NaN
9	Advanced Project Skills	Route Protection in React	Enables real-time, secure, and media-intensive app capabilities.	NaN
9	Advanced Project Skills	Redux / Zustand / Recoil	Enables real-time, secure, and media-intensive app capabilities.	NaN
9	Advanced Project Skills	Service Workers	Enables real-time, secure, and media-intensive app capabilities.	NaN
9	Advanced Project Skills	Manifest.json	Enables real-time, secure, and media-intensive app capabilities.	NaN
9	Advanced Project Skills	Offline Support	Enables real-time, secure, and media-intensive app capabilities.	NaN
9	Advanced Project Skills	HLS.js	Enables real-time, secure, and media-intensive app capabilities.	NaN
9	Advanced Project Skills	Custom Video Controls	Enables real-time, secure, and media-intensive app capabilities.	NaN
9	Advanced Project Skills	FileReader API	Enables real-time, secure, and media-intensive app capabilities.	NaN
9	Advanced Project Skills	FormData	Enables real-time, secure, and media-intensive app capabilities.	NaN
9	Advanced Project Skills	Web Notifications	Enables real-time, secure, and media-intensive app capabilities.	NaN
9	Advanced Project Skills	IndexedDB	Enables real-time, secure, and media-intensive app capabilities.	NaN
10	Production & Deployment	Jest & React Testing Library	Ensures reliability, maintainability, and launch readiness.	NaN
10	Production & Deployment	Component & Unit Testing	Ensures reliability, maintainability, and launch readiness.	NaN
10	Production & Deployment	Vercel / Netlify Deployment	Ensures reliability, maintainability, and launch readiness.	NaN
10	Production & Deployment	Build Optimization	Ensures reliability, maintainability, and launch readiness.	NaN
10	Production & Deployment	CI/CD Basics (GitHub Actions)	Ensures reliability, maintainability, and launch readiness.	NaN

h1>🧠 System Design Mastery Roadmap

I. 🧱 FOUNDATIONS

Topic	Subtopics	Free Resources
1. System Design Fundamentals	What is System Design? HLD vs LLD: goals, deliverables, interview prep. Design Process: Requirements → Design → Trade‑offs → implementation->Testing	Free System Design Course (GitHub) :contentReference[oaicite:1]{index=1} freeCodeCamp System Design for Beginners :contentReference[oaicite:2]{index=2}
2. Requirements Engineering	Functional: user stories, use cases Non‑functional: scalability, reliability, availability, performance, security, maintainability. Concepts: SLA, SLO, SLI (quantify service quality).	freeCodeCamp Course :contentReference[oaicite:3]{index=3}
3. Networking & Protocols	TCP/IP Model, layers and functioning. HTTP/1.1 vs HTTP/2 vs HTTP/3,REST vs RPC vs gRPC UDP, Sockets, WebSockets DNS, TLS Handshake, Certificates	freeCodeCamp Course :contentReference[oaicite:4]{index=4}
4. API Design	REST principles (resource-based URIs, HATEOAS) API versioning, pagination, status codes, idempotency. Interface definition: Swagger/OpenAPI. Error handling, rate limits, error codes.	GeeksforGeeks System Design Tutorial :contentReference[oaicite:5]{index=5}

II. 🏗️ HIGH-LEVEL DESIGN (ARCHITECTURE)

Topic	Subtopics	Resources
1. Scalability & Performance	Horizontal vs Vertical Scaling Latency vs Throughput , bottleneck analysis. Performance tuning, Profiling	Awesome System Design Resources :contentReference[oaicite:6]{index=6}
2. Reliability & Availability	Redundancy, replication, failover. Circuit Breaker, retries, back-off, timeout. Health checks, canary & blue‑green deploys.	Awesome System Design Resources :contentReference[oaicite:7]{index=7}
3. Database Systems	SQL vs NoSQL Transaction Models Consistency Guarantees Schemas (Fixed in SQL vs Flexible in NoSQL) ACID vs BASE ACID (Atomicity, Consistency, Isolation, Durability) – SQL systems BASE (Basically Available, Soft state, Eventually consistent) – NoSQL systems Normalization vs Denormalization Normalization: Minimizing redundancy (SQL) Denormalization: Adding redundancy for read performance (NoSQL) Indexing Improves query performance Types: B-Tree, Hash, Full-text, etc. Query Optimization Rewriting queries for better performance Choosing optimal indexes and join strategies Explain Plans Visualize how the database engine executes a query Identify and fix performance bottlenecks Sharding & Partitioning Sharding: Horizontal scaling (split rows across nodes) Vertical Partitioning: Splitting columns for performance Replication Models Master-Slave: One write node, many read replicas Multi-Master: Multiple write nodes with conflict resolution CAP Theorem Consistency, Availability, Partition tolerance – pick 2 of 3 Describes trade-offs in distributed systems Consistency Models Strong Consistency: Always up-to-date reads Eventual Consistency: Data becomes consistent over time	Awesome System Design Resources :contentReference[oaicite:8]{index=8}
4. Caching Layers	Use-cases Reduce latency Offload database Strategies LRU (Least Recently Used) LFU (Least Frequently Used) TTL (Time To Live) cache eviction Write Policies Write-through Write-behind Write-around Cache Coherence & Invalidation Maintain consistency between cache and data source Techniques for invalidating stale cache entries Tools Redis Memcached	Awesome System Design Resources :contentReference[oaicite:9]{index=9}
5. Load Balancing	Types DNS-based Hardware Software (e.g., HAProxy, NGINX) Algorithms Round-robin Least connections IP-hash Other Key Concepts Health checks Sticky sessions (session persistence) Advanced Load Balancing Global Load Balancing Geo-proximity routing	Awesome System Design Resources :contentReference[oaicite:10]{index=10}
6. Messaging & Astro Flows	Synchronous vs Asynchronous Calls Synchronous: Blocking, waits for a response Asynchronous: Non-blocking, handles response later Message Queues Kafka RabbitMQ AWS SQS Messaging Patterns Publish/Subscribe (Pub/Sub) Fan-out Event Streams Architectural Patterns Event-driven Design Outbox Pattern (reliable event publishing)	Awesome System Design Resources :contentReference[oaicite:11]{index=11}
7. API Gateways & Edge Patterns	API Gateway Responsibilities Routing Aggregation Rate Limiting Authentication and Authorization GraphQL vs REST vs gRPC GraphQL: Flexible queries, single endpoint REST: Resource-based, multiple endpoints gRPC: Binary protocol, high-performance, uses Protobuf Throttling vs Rate Limiting Throttling: Controls traffic to avoid overload (temporary slowdown) Rate Limiting: Enforces a fixed request limit per time period	Awesome System Design Resources :contentReference[oaicite:12]{index=12}
8. CDN & File Systems	CDN Fundamentals Edge Caching Cache Invalidation File Storage Services Amazon S3 Google Cloud Storage (GCS) Azure Blob Storage Upload Mechanisms Chunked Uploads Pre-signed URLs Streaming Protocols HLS (HTTP Live Streaming) DASH (Dynamic Adaptive Streaming over HTTP)	freeCodeCamp Course :contentReference[oaicite:13]{index=13}
9. Security & Auth at Scale	Authentication JWT (JSON Web Token) OAuth2 OAuth Flows Authorization Code Flow Implicit Flow Authorization RBAC (Role-Based Access Control) ABAC (Attribute-Based Access Control) Encryption In Transit (e.g., TLS/HTTPS) At Rest (e.g., Encrypted databases, storage) Security Best Practices Input Validation Secure Headers WAF (Web Application Firewall)	GeeksforGeeks :contentReference[oaicite:14]{index=14}
10. Observability & Monitoring	Logs ELK Stack (Elasticsearch, Logstash, Kibana) Metrics Prometheus + Grafana Distributed Tracing Jaeger Zipkin Dashboarding & Alerts Custom Dashboards (e.g., Grafana) Alert Policies SLO (Service Level Objective) Alerts	Awesome System Design Resources :contentReference[oaicite:15]{index=15}
11. Reliability Patterns	Core Patterns Circuit Breaker Retry with Jitter Timeouts Bulkhead Isolation Traffic Control Rate Limiting Throttling Stability Strategies Backpressure Graceful Degradation Chaos Engineering High Availability Redundancy Failover Strategies	Awesome System Design Resources :contentReference[oaicite:16]{index=16}

III. 🧩 LOW-LEVEL DESIGN (LLD)

Topic	Subtopics	Resources
1. Object-Oriented Principles	SOLID Principles SRP – Single Responsibility Principle OCP – Open/Closed Principle LSP – Liskov Substitution Principle ISP – Interface Segregation Principle DIP – Dependency Inversion Principle OOP Fundamentals Encapsulation Abstraction Inheritance Polymorphism Design Preferences Composition over Inheritance Code Quality Concepts Cohesion Coupling	SOLID principles (DigitalOcean) :contentReference[oaicite:17]{index=17}
2. Design Patterns	Design Patterns Creational Patterns Singleton Factory Method Abstract Factory Builder Prototype Structural Patterns Adapter Facade Composite Decorator Proxy Behavioral Patterns Strategy Observer Command State Template Method Iterator Chain of Responsibility	Awesome LLD Resources (GitHub) :contentReference[oaicite:18]{index=18}
3. Modeling & UML	Class Diagrams Class Structure Associations Aggregations Sequence Diagrams Object Lifecycles Messaging Between Objects Activity & State Diagrams Workflows (Activity Diagrams) State Transitions (State Diagrams) Component Diagrams System Components Dependencies Between Components	UML Diagrams Full Course (YouTube) :contentReference[oaicite:19]{index=19}
4. Service Interface Design	Design Principles Clearly Defined Interfaces Abstraction Boundaries Dependency Management Dependency Injection (DI) Inversion of Control (IoC) Testability Mocking Writing Testable Code Architecture Patterns Module Layering (e.g., Presentation, Business, Data)	GeeksforGeeks LLD article :contentReference[oaicite:20]{index=20}
5. LLD Case Tasks	Library, Parking Lot, ATM, Hotel Booking	Best LLD Resources (GitHub) :contentReference[oaicite:21]{index=21}

IV. 🧠 ARCHITECTURE PATTERNS & STYLES

Topic	Details	Resources
1. Monolith vs Microservices Advantages Drawbacks Core Decomposition Patterns Inter-service Communication Distributed Data Management 2. SOA & Microservices SOA Principles ESB vs Microservices Service Contracts Bounded Contexts Domain Separation 3. Event-Driven Architecture Producers and Consumers Event Brokers CQRS (Command Query Responsibility Segregation) Event Sourcing Outbox Pattern Stream Processing Kafka Topics and Partitions 4. Domain-Driven Design (DDD) Entities Value Objects Aggregates Repositories Services Ubiquitous Language Bounded Contexts Context Mapping 5. Reliability & Resiliency Patterns Circuit Breaker Bulkhead Retry Rate Limiter Saga: Orchestration and Choreography CAP Theorem Trade-offs	Covers all major architecture patterns & trade-offs	Awesome System Design Resources :contentReference[oaicite:22]{index=22}

V. 🧪 SYSTEM CASE STUDIES

System	Focus Areas	Resources
URL Shortener Hashing Collision Handling Link Expiry Analytics Dashboard Rate Limiting Twitter Feed Fan-out vs Fan-in Real-time Updates vs Pulling Caching Ranking Algorithms YouTube Upload Pipeline Video Encoding CDN Integration Metadata Extraction Recommendation Engine Netflix Video Processing Pipeline Stream Delivery Personalization Throttling WhatsApp Message Handling End-to-End Encryption Delivery Acknowledgements (ACKs) User Presence Offline Sync Instagram Media Storage Feed Generation Likes & Comments Tagging Uber Geo-Partitioning Driver Matching ETA Calculation Surge Pricing E-commerce Product Catalog Shopping Carts Inventory Management Checkout Process Payment Gateway Integration Collaborative Editing CRDT (Conflict-free Replicated Data Types) Operational Transform (OT) Zoom / Google Meet Media Signaling WebRTC Gateways Scalability Considerations Parking Lot / Library / ATM Core OOP Design Low-Level Design (LLD) UML Diagrams	HLD, LLD, flows, data models, scalability	Free Case Study Course (GitHub) :contentReference[oaicite:23]{index=23}

VI. 🛠️ PLATFORMS & TOOLS

Explore using specific tools: MySQL, Redis, Kafka, ElasticSearch, S3, Docker, Kubernetes, Prometheus, ELK.

General coverage available in Awesome System Design Resources :contentReference[oaicite:24]{index=24}.

VII. 📈 SOFT & STRATEGIC SKILLS

Trade-offs, communication, cost estimation, documentation, incident management. Use the case-study course and system design roadmap from GitHub as practical practice.

GitHub Roadmap :contentReference[oaicite:25]{index=25}

🐳 Docker Topics

Topic	Subtopics	Resource Link
Docker Fundamentals	What is containerization? VM vs Containers Benefits: portability, isolation, CI/CD Docker architecture: Client, Daemon, Registry Container lifecycle: create, start, stop, exec, remove	Docker 101 Tutorial :contentReference[oaicite:1]{index=1}
Docker Installation & CLI	Installing Docker on Linux, Windows, macOS docker run, exec, ps, stop, rm Detached mode (-d), interactive mode (-it) Port mapping (-p), volume mounting (-v)	TutorialsPoint Docker :contentReference[oaicite:2]{index=2}
Docker Images	What is a Docker image? Layers & union file systems Dockerfile: FROM, RUN, CMD, COPY, ENTRYPOINT, EXPOSE, ENV Image tagging, multistage builds, .dockerignore	Alison: Docker Fundamentals :contentReference[oaicite:3]{index=3}
Volumes & Bind Mounts	Bind mounts vs named volumes Volume lifecycle, backup & restore	Docker 101 Tutorial :contentReference[oaicite:4]{index=4}
Networking	Bridge, Host, None networks Custom networks, DNS linking	TutorialsPoint Docker :contentReference[oaicite:5]{index=5}
Docker Compose	docker-compose.yml syntax Commands: up/down, logs, build Defining services, volumes, networks	Play With Docker Playground :contentReference[oaicite:6]{index=6}
Docker Registry	DockerHub, GHCR, AWS ECR, GCR docker push/pull, self‑hosted registry	Docker 101 Tutorial :contentReference[oaicite:7]{index=7}
Security in Docker	Non-root containers Content Trust, Image Scanning Seccomp, AppArmor, Capabilities	Docker 101 Tutorial :contentReference[oaicite:8]{index=8}

☸️ Kubernetes Topics

Topic	Subtopics	Resource Link
Core Concepts	What is Kubernetes? Components: API Server, Scheduler, Controller Manager, kubelet, kube-proxy Cluster, Node, Pod, Namespace	Kubernetes Basics (official) :contentReference[oaicite:9]{index=9}
Kubernetes Objects	Pods, ReplicaSets, Deployments Services: ClusterIP, NodePort, LoadBalancer Jobs, CronJobs, StatefulSets, DaemonSets	Kubernetes Concepts Guide :contentReference[oaicite:10]{index=10}
Networking	DNS, CNI, Pod-to-Pod communication Ingress Controllers, Network Policies	Kubernetes Concepts Guide :contentReference[oaicite:11]{index=11}
Storage	Volumes, PVs & PVCs Storage Classes, Access Modes	Kubernetes Storage Concepts :contentReference[oaicite:12]{index=12}
Configuration	Env vars, Secrets kubectl commands, YAML best practices Labels, Taints, Affinity	Kubernetes Concepts Guide :contentReference[oaicite:13]{index=13}
Helm	Charts, Templates, values.yaml install, upgrade, rollback	Helm Docs (overview)
Observability & Debugging	kubectl logs, describe, exec Prometheus, Grafana, Dashboard Tracing: Jaeger, OpenTelemetry	Kubernetes Monitoring Tutorials
Security	RBAC, Pod Security Standards Secrets management, OPA/Gatekeeper	Kubernetes Security Concepts
CI/CD Integration	Docker + K8s in Pipelines GitOps (ArgoCD, Flux), Jenkins, GitHub Actions	KubeAcademy Free Courses :contentReference[oaicite:14]{index=14}
Service Mesh	Istio, Linkerd Sidecars, mTLS, traffic shifting	Istio Documentation
Production Practices	Autoscaling, PDB, Blue-Green & Canary Logging: ELK/EFK	Cluster Administration Guide
Tools & Ecosystem	Lens IDE, Skaffold, Tilt, K9s Kustomize, CRDs & Operators	LabEx Kubernetes Tutorials :contentReference[oaicite:15]{index=15}
Cloud Kubernetes	GKE, EKS, AKS Minikube, kind	Kubernetes Tutorials (official) :contentReference[oaicite:16]{index=16}

Redis

Topic	Subtopics	Resource Link
What is Redis?	In‑memory data structure store Speed benefits & use cases	Redis Introduction (official)
Installation	Linux/macOS/Windows install Redis CLI	Quickstart & CLI
Data Types	Strings, Lists, Sets, Sorted Sets, Hashes Bitmaps, HyperLogLogs, Streams, GEO Indexes	Redis Data Types (official)
CLI Commands	SET, GET, DEL, INCR, EXISTS, TTL, EXPIRE TYPE, KEYS, SCAN	Redis Commands Reference
Persistence Overview	RDB & AOF basics Why Redis is more than just cache	Persistence in Redis

📦 II. Redis as a Cache

Topic	Subtopics	Resource Link
Caching Use Cases	Session storage, API response cache, DB caching	Redis Cache Use Cases
TTL & Expiration	EXPIRE, TTL, SETEX, PERSIST	Redis Expire Commands
Cache Invalidation	DEL/EXPIRE, lazy vs proactive invalidation	Cache Invalidation Patterns
Eviction Policies	LRU, LFU, Random, volatile vs all-keys eviction	Eviction Policies Guide
Performance Tips	Cache warming, pooling, pipelining	Redis Performance Tips

📑 III. Redis Data Structures (Deep Dive)

Data Type	Commands / Use‑Cases	Resource Link
Strings	SET, GET, MSET, APPEND, counters	Strings
Lists	LPUSH, RPUSH, LPOP, LRANGE (queues, logs)	Lists
Sets	SADD, SREM, SMEMBERS, SINTER, SUNION	Sets
Sorted Sets	ZADD, ZRANGE, ZREM (leaderboards)	Sorted Sets
Hashes	HSET, HGET, HMGET, HDEL	Hashes
Bitmaps	SETBIT, GETBIT, BITCOUNT	Bitmaps
HyperLogLog	PFADD, PFCOUNT (cardinality)	HyperLogLog
Streams	XADD, XREAD, consumer groups	Streams
Geo	GEOADD, GEODIST, GEORADIUS	Geo Indexes

🚦 IV. Redis Pub/Sub

Topic	Subtopics	Resource Link
What is Pub/Sub?	Messaging, real‑time broadcast	Pub/Sub Overview
Commands	PUBLISH, SUBSCRIBE, UNSUBSCRIBE, PSUBSCRIBE	Pub/Sub Commands
Use-Cases & Limitations	Chat, notifications, no durability or ack	Pub/Sub Guide

🧪 V. Persistence & Durability

Topic	Subtopics	Resource Link
RDB	SAVE, BGSAVE, rdb files	Persistence Overview
AOF	appendonly yes, rewrite policies	Append-Only File
Hybrid Persistence	Combining AOF + RDB	Hybrid Setup
Backup & Restore	RDB copy, AOF replay	Backups
fsync & Performance	Durability vs latency	fsync and latency

h2>🔁 VI. Redis Transactions, Lua & Pipelines

Topic	Subtopics	Resource Link
Transactions	MULTI, EXEC, WATCH Atomicity in Redis	Redis Transactions Overview
Optimistic Locking	Use WATCH for concurrent safety	WATCH Usage
Lua Scripting	EVAL, EVALSHA, avoiding race conditions	Lua Scripting Guide
Pipelining	Sending multiple commands to reduce RTT	Redis Pipelining
Use Cases	Queues, atomic ops, batched reads/writes	Lua & Pipelining Examples

🏗️ VII. Redis in Production

Topic	Subtopics	Resource Link
Redis Configuration	redis.conf, maxmemory, timeout, logs	Redis Configuration Reference
Memory Optimization	Compression, eviction, usage patterns	Memory Optimization
Monitoring	INFO, MONITOR, slowlog	Monitoring Redis
Metrics & Logging	Prometheus + Grafana dashboards	Redis + Prometheus
Security	AUTH, ACLs, TLS	Redis Security
Clustering vs Replication	Scale-out, HA differences	Replication Guide

🧩 VIII. Redis Scaling & High Availability

Topic	Subtopics	Resource Link
Redis Replication	Master-slave, SLAVEOF/REPLICAOF	Replication Setup
Redis Sentinel	Auto-failover, monitoring, quorum	Redis Sentinel Guide
Redis Cluster	Sharding, hash slots, data distribution	Redis Cluster](https://redis.io/docs/manual/scaling/)
Client-side Sharding	Client partition logic	Client-side Partitioning
Load Balancing	Twemproxy, cluster-aware clients	Proxy Tools Guide
Failover	Sentinel vs Cluster orchestration	Failover Strategies
Common Issues	Partitioning gotchas, stale reads	Scaling Pitfalls

📡 IX. Redis Ecosystem & Tools

Tool	Use	Resource Link
RedisInsight	GUI for monitoring/debugging	RedisInsight
Redisson	Java client with advanced features	Redisson Docs
Jedis, Lettuce	Lightweight Java clients	Jedis, Lettuce
ioredis	Node.js Redis client	ioredis
celery + Redis	Task queue in Python	Celery Redis
Django/Flask cache	Web cache backend	Flask Caching, Django Cache
Sidekiq + Redis	Background jobs in Ruby	Sidekiq Docs
Kafka vs Redis Streams	Pub/sub vs streams comparison	Redis Streams vs Kafka

🛠️ X. DevOps, Docker & Cloud Integration

Topic	Subtopics	Resource Link
Redis with Docker	docker run, mount volumes	Official Redis Docker Image
Docker Compose	Redis + app container	Compose File Guide
Kubernetes Redis	Helm + Sentinel/Cluster on K8s	Redis Helm Chart
Redis on Cloud	ElastiCache, Memorystore, Azure Cache	AWS ElastiCache
Terraform + Redis	IaaC	Terraform Redis Provider
Redis Benchmarking	redis-benchmark, latency/tests	Benchmarking Redis
Horizontal Scaling	Cluster + Sentinel in cloud-native apps	Scaling Guide

🔬 XI. Redis Internals (advanced)

Topic	Subtopics	Resource Link
Event Loop	Single-threaded I/O model	Redis Internals
RDB/AOF Internals	Fork, copy-on-write	Persistence Internals
Memory Allocation	jemalloc, fragmentation	Memory Internals
Command Execution	Latency, blocking commands	Command Internals
Redis Modules	Extending via modules	Redis Modules
Time Complexity	O(1), O(n), O(log n)	Time Complexity Table

Mongo DB

Topic	Subtopics	Resource
What is MongoDB?	Document-based NoSQL DB, JSON/BSON	MongoDB Introduction (official)
Features	Schema-less, indexing, scalability	MongoDB Core Concepts
MongoDB vs SQL	Collections vs Tables, Schema-on-Read	SQL vs MongoDB Guide
Installation & Setup	Install on Linux/Windows/macOS, Mongo Shell & Compass	MongoDB Installation Guide
MongoDB CLI & Compass	mongosh, GUI basics, connection strings	MongoDB Shell Guide

📂 II. Data Modeling & Collections

Topic	Subtopics	Resource
Documents	Fields, embedded docs, arrays	Document Model
Collections	Insert/update docs	Collections Overview
Schema Design	Embedding vs Referencing	Data Modeling Guide
Normalization vs Denormalization	When embed or reference	Schema Patterns
Schema Best Practices	1:M, M:M, doc size limits	Data Modeling Guide
Schema Validation	JSON Schema validators	Schema Validation
ObjectId	Generation, timestamp info	ObjectId Explained

🔁 III. CRUD Operations

Topic	Subtopics	Resource
Create	insertOne, insertMany	CRUD Operations (official)
Read	find, projections, filtering	Query Docs
Update	updateOne, $set, $inc, etc.	Update Docs
Delete	deleteOne, deleteMany	Remove Docs
Query Operators	$eq, $gt, $or, etc.	Query Operators
Cursors	.forEach(), .toArray()	Cursors Docs
Sorting & Limiting	sort(), limit(), skip()	Sort & Limit

🔎 IV. Indexing & Performance

Topic	Subtopics	Resource
What is an Index	Improve query speed	MongoDB Indexes
Types of Indexes	Single, compound, multikey	Types of Indexes
Unique, TTL, Text Indexes	Data constraints, expiry, search	TTL Index \| Text Index
Geospatial Indexes	2d, 2dsphere	Geospatial Indexing
Covered Queries	Index-only reads	Covered Queries
Index Stats	explain(), stats()	Explain Plan

🔧 V. Aggregation Framework

Topic	Subtopics	Resource
What is Aggregation	Pipeline-based analysis	Aggregation Pipeline
Stages	$match, $group, $sort...	Aggregation Stages
Array & Logic Operators	$unwind, $map, $cond...	Aggregation Operators
Lookup & Faceting	$lookup, $facet	Lookup

📃 VI. Data Relationships

Relationship	Strategy	Resource
1-to-1, 1-to-Many	Embed or Reference	Modeling Relationships
Many-to-Many	Use referencing	Data Modeling

🛡️ VII. Security

Topic	Subtopics	Resource
Authentication	Users & roles	Authentication
Authorization	RBAC	Authorization
Network Security	IP allowlist, TLS	TLS Setup
Encrypted Storage	Encryption at rest	Encryption at Rest

📧 VIII. Replication & High Availability

Topic	Subtopics	Resource
Replication Basics	Primary-Secondary	Replication Guide
Replica Sets	Oplog, elections	Replica Set
Read/Write Concerns	Consistency levels	Read Concern
Read Preferences	Primary, Secondary	Read Preference

📈 IX. Sharding & Scalability

Topic	Subtopics	Resource
What is Sharding?	Horizontal partitioning	Sharding Guide
Shard Keys	Choosing fields	Shard Key Selection
Cluster Architecture	Mongos, Config Server	Sharded Cluster

📦 X. Backup, Restore & Monitoring

Topic	Subtopics	Resource
Backup	mongodump, snapshots	Backup Tools
Monitoring	Metrics, logs	Monitoring Guide
Profiler	Query performance	Profiler

🚀 XI. Advanced Features

Topic	Subtopics	Resource
Transactions	Multi-document ACID	Transactions
Change Streams	Real-time change notifications	Change Streams
Field Encryption	FLE & secure fields	Field-Level Encryption
Time Series	IoT data, metrics	Time Series

🧰 XII. Ecosystem & Tools

Tool	Purpose	Resource
MongoDB Compass	GUI & schema view	Compass Download
Atlas	Managed cloud DB	MongoDB Atlas
Mongoose	ODM (Node.js)	Mongoose Docs
PyMongo	Python client	PyMongo Docs
Spring Data MongoDB	Java integration	Spring MongoDB

Topic	Subtopics	Resource Link
Introduction & Setup	What is React Native? Environment setup (Expo or CLI) Hello World app	Official Getting Started :contentReference[oaicite:1]{index=1}
Core React Concepts	JSX Components & Props State & Hooks Lifecycle	React Native Tutorial :contentReference[oaicite:2]{index=2}
Core Components & Styling	View, Text, Image TextInput, ScrollView Flexbox layout StyleSheet	Official Components Doc :contentReference[oaicite:3]{index=3}
Navigation	React Navigation setup Stack, Tab, Drawer navigators Deep linking	Navigation basics :contentReference[oaicite:4]{index=4}
State Management	Context API Redux / MobX / Zustand	State management overview :contentReference[oaicite:5]{index=5}
API & Async	Fetch / Axios AsyncStorage Networking & offline support	Networking & Async Tutorials :contentReference[oaicite:6]{index=6}
Device APIs	Permissions Camera / Geolocation Push Notifications	Cheat Sheet w/ APIs :contentReference[oaicite:7]{index=7}
Styling & Layout	Flexbox deep-dive Theming, responsive styles	Flexbox and styling tutorials :contentReference[oaicite:8]{index=8}
Lists & Performance	FlatList, SectionList Virtualization Performance optimizations	Cheat Sheet Performance :contentReference[oaicite:9]{index=9}
Navigation Deep Dive	React Navigation advanced patterns Gesture Handler & Reanimated	Deep navigation & gestures :contentReference[oaicite:10]{index=10}
Animations	Animated API Reanimated 2	Reanimated Tutorial :contentReference[oaicite:11]{index=11}
Forms & Validation	TextInput management Formik / React Hook Form	Forms guide :contentReference[oaicite:12]{index=12}
Testing & Debugging	Jest & Testing Library Detox, Appium Debugging tools	Testing and debugging tutorials :contentReference[oaicite:13]{index=13}
TypeScript Support	Static typing TSX components	TS integration tutorial :contentReference[oaicite:14]{index=14}
Native Modules	Writing custom native modules Bridging with Kotlin/Swift	Native Modules Tutorial :contentReference[oaicite:15]{index=15}
Deployment	Building APK/IPA App Store & Play Store releases Over-the-air updates	Deployment checklist :contentReference[oaicite:16]{index=16}
Performance & Optimization	Profiling with performance monitor Memory leak detection	Optimization tips :contentReference[oaicite:17]{index=17}
Offline & Storage	AsyncStorage Secure storage Local DB (SQLite, Realm)	Offline storage sheet :contentReference[oaicite:18]{index=18}
Project Structure & Tools	Folder structure best practices Skaffold, Metro bundler React Native CLI & Expo	Full Course Walkthrough :contentReference[oaicite:19]{index=19}
Community & Resources	Official docs & blog Discord, Spectrum, GitHub repos	Official React Native site :contentReference[oaicite:20]{index=20}

📚 Topics