Professional Summary
Detail-oriented Data Engineer with over 6.5 years of experience in data pipelines, backend APIs, cloud infrastructure, and big data tools. Skilled in Python, SQL, AWS, LLM RAG Pipeline, Airflow, and PySpark. Proven ability to build scalable systems and support data-driven decision-making in banking and enterprise settings.
Professional Experience
- Led data governance and built secure data pipelines
- Architected and developed full-stack, API-based applications with LLM integration to streamline internal banking operations and reporting workflows.
- Created SQL dashboards using Hive, Impala
- Collaborated across departments for compliance and analytics
Technical Skills
- Python-3, Pyspark, SQL, Bash, HTML, JavaScript, Vue.js
- Django, Flask, Go, Symfony, REST API
- AWS: Lambda, API Gateway, S3, EC2, CloudFront, IAM, DynamoDB, Glue, Athena, Textract, Rekognition, Amazon Bedrock, Boto3
- Docker, Git, Linux, Ansible, Bash
- Infrastructure as Code: Terraform, CloudFormation, Serverless Framework
- PySpark, Hive, Impala
- Data Pipelines with Apache Airflow (DAGs, Operators)
- Reporting via SQL (Impala, Hive, MySQL Workbench)
- Prometheus, Grafana, Nagios, Telegraf
- Automation Scripts using Python & Bash
- Vue.js, React (Basic)
- VS Code, Sublime Text, PyCharm, JupyterLab
- OS Preference: Ubuntu 20.04 / Unix-based systems
- Pandas, Scikit-learn, TensorFlow
- Machine Learning, Data Analysis
Highlighted Projects
Education
Certifications
Data Engineering
-
Introduction to Data Engineering
Coursera • DeepLearning.AI • Joe Reis & Morgan Willis -
Source Systems, Data Ingestion, and Pipelines
Coursera • DeepLearning.AI • Joe Reis & Morgan Willis -
Data Engineering using AWS Data Analytics
Udemy • Durga Viswanatha RajuHands-on implementation using AWS Glue, Athena, Redshift, Kinesis, and related data engineering services.
-
Apache Airflow: Hands-On Introduction
Udemy • Marc LambertiBuilt and orchestrated workflows using DAGs, Operators, Scheduling, and Monitoring.
-
Cypher Fundamentals
Neo4j GraphAcademyGraph modeling, Cypher queries, data retrieval, and graph data manipulation.
Artificial Intelligence & Machine Learning
-
Machine Learning Specialization
Coursera • Andrew Ng -
Prompt Engineering with Llama 2 & Llama 3
DeepLearning.AI • Meta -
Amazon Rekognition Development: A Complete Guide
Udemy • Dhiman HalderDeveloped image and video analysis workflows using AWS Rekognition, Lambda, and Amazon S3.
Generative AI
-
Vibe Coding 101 with Replit
DeepLearning.AI • Replit
Hobbies
- Solo Travelling
- Photography
- Playing Tabla
Languages
- English: Full Professional Proficiency
- Bengali: Native/Bilingual Proficiency
- Hindi: Full Professional Proficiency
Extracurricular Activities
- Represented Science Exhibition on Chemistry at School
- Presented Seminar on Open Source Software at College
Preferences
- Preferred Editors: VS Code, Sublime Text 4, PyCharm
- Preferred OS: Ubuntu 20.04 or any Unix-based OS
Contact Information
Current Address:
39/1 Kaibartapara, Barasat, West Bengal, India – 700124
Phone: +91 98306 99062
Email: debasisnth@gmail.com