- Building modern microservice-based applications using Python, Go, AI (GenAI),LLM and  AWS.
- Using Python to write functional programs and blending them with Data Engineering.
- Creating Next Gen Data Pipelines.
- Building low latency, high-throughput APIs.
- Project ownership from start to end. 
- Working with internal and external stakeholders.
- Debugging production issues across the entire stack.
- Improving engineering standards, tooling, and processes.
- Working as a Polyglot Developer.
- Leading/Mentoring team members.

Principal Engineer

Packt

Technical Book Title: 
Building ETL Pipelines with Python

The Book's Goal:
There are no books or free material available online which gives hands-on knowledge on how to create production-grade, robust, and resilient data pipelines using Python, which can be scaled to process  Petabytes of data. Most of the available books and free material are academic in nature and lack an in-depth explanation of scalable pipelines that adhere to industry standards.

Author

MentorCruise

Acted as a mentor at MentorCruise, guiding and supporting peers in their journey into the tech industry, sharing my expertise in Python, Cloud, and Go technologies.

Peer Mentor

Type: Development from Scratch
Role: Python Engineer (Cloud)

Technology Used: Python,Dask,Flask,React,MySql,PySpark,Docker,Go,AWS,Kubernetes,Microservices,GraphQL

Responsibilities:

-Migrated monolith applications to microservice-based services using AWS, Python, Go, and Flask.
-Wrote extendible code using TDD approach and containerized apps using Docker.
-Created production-grade POC.
-Worked with various data pipelines using AirFlow, Dask Pandas, and Numpy.
-Leveraged AWS lambda, AWS ECS, AWS Elasticache, and DynamoDB for various services.
-Created high-performance, scalable RestFul APIs using Python(Flask) /AWS API Gateway for various enterprise applications.
-Worked on Single Page Applications using React by consuming RESTFul APIs.

Senior Python Developer at Cigna

Project Type : Data Processing and ETL with Python and Pyspark 
Role: Python Data Engineer | Python Developer

- Responsible for creating a Data Pipeline using Airflow, Kafka, and Python.
- Processed billions of records with limited nodes and capacity.
- Built a persistent system similar to DaaS(Data as service) to make the data available 24x7 for users.

Technology Used: Python,Flask,Spark,Kafka,JavaScript, SQL,Docker,Go, Go,RPC,AMQP,Nameko,Microservices ,Kubernetes,Lettuce,Pandas,Numpy, Elasticsearch, Redis,React,AWS lambda, AWS ECS, AWS Elasticache, DynamoDB,AWS API Gateway,Dask,Numba,Django,Python Developer

Python Data Engineer at Cigna

Cognizant

Project: Crew Management Systems
Client: Alaska Airlines Inc. 
Type: Development from Scratch 
Role: Source Code Developer | Python Developer | Data Engineer
Technology: Python, Django, RabbitMQ, JavaScript, Shell Scripting, SQL, NoSQL
Brief:  
• Developed Distributed and Robust applications using Python, Django, RabbitMQ, and TinyDB.
• Data Analysis and Visualization using Pandas, Numpy and Matplotlib. 
• Implemented business methods in Python to retrieve and manipulate data.
• Created complex SQL queries and stored procedures for performing various CRUD operations.
• Used HTML, CSS, JSON, Yaml, and JavaScript for front-end applications. 
• Designed and developed database object parsing, dependency builder, and documenting software in Python using object-oriented features.
•Successfully Implemented RabbitMQ in a distributed fashion to make information available in real-time to help admins and decision-makers.

Full Stack Engineer (Python) at Alaska Airlines

Client: JPMorgan Chase and Co.
Type: Development from Scratch, Deployment, Testing, Support, Maintenance
Role: Senior Python Developer 
Technology Used: Python, Groovy, JavaScript, Flask, Shell Scripting, SQL, NoSQL, Sybase

Brief:  

IVoRI (Independent Valuation Reporting Infrastructure) is a JPMC strategic project. 
The IVoRI application (a reporting tool) replaces the Cognos Reporting Tool.
The project includes work streams created for the multi-year IRIS (Independent Revaluation Infrastructure) supporting the VCG (Valuation Control Group) business.
RESPONSIBILITIES:
Originated new and innovative high-performance applications using Python –WxPython | Enaml and other Python modules. 
•      Created Data Pipelines using Python.
•      Designed, Developed, and maintained the reporting App IVoRI using WxPython and many more libraries.
•	Migrated the ETL process from Informatica to Python Pandas and other custom libraries.
•	Troubleshoot issues and bug fixes, and implement enhancements as required. 
•	Spearheaded running of Unit Test Cases for better test coverage. 
•	Implemented the TDD process.
•	Collaborated on analysis, coding, and migration of existing applications. 
•	Delivered superior client services through interfacing with clients for clarifications, feedback, deliveries, and project planning.

Senior Python Developer at JPMorgan Chase & Co.

Project - Amex Personalization 
Client: American Express UK.
Type: Development
Role: Developer
Technology Used: Java, Python, SQL 

Brief: 

The Personalization Utility is aimed at transforming the process that American Express markets its products and services to its clients. This project presents offers and content most relevant to the customers. The project simultaneously aims to deliver the greatest benefit to the enterprise as a whole as it allows American Express to tailor its services and products to meet customer preferences efficiently and make interactions faster and easier.

RESPONSIBILITIES:
•	Served as lead Source Code Developer using Python and Java.
•	Automated multiple data-related tasks saving 80 man-hours per week.
•	Automated the content management tasks to update the seasonal card offers.

Project: Employee Roster Management 
Client: 3M Company
Type: Development from Scratch.
Role: Developer
Technology Used: Java, Python, MYSQL

RESPONSIBILITIES:
•	Utilized IT expertise as a full-stack developer using Java, Javascript, Spring, HTML, and CSS.
•	Cultivated strong relationships with clients and kept communications channels flowing freely for frequent interaction for progressive status.
•	Performed code coverage tasks for the assigned modules; monitored thousands of lines of code to ensure smooth software operations.

Backend Engineer at Amex

Opinions expressed are solely my own and do not express the views or opinions of my employer.

I am a seasoned professional who can design, develop, and deliver scalable and robust applications using Python, Go, Cloud, Databricks and AI. I am also an author, a GenAI strategist, a data professional and an architect, with a passion for innovation and learning.

Currently, I am working as a Principal Software Engineer at ADP, one of the world's largest providers of human resources and payroll solutions. In this role, I am leading the development of modern microservice-based applications using Python, Go, AWS, and AI, as well as building ETL pipelines with Python to process strategic data. I work collaboratively with senior leaders, clients, SRE and Security teams to ensure the successful completion of projects that focus on cloud, machine learning, artificial intelligence, and microservices. I am driven by the mission of creating value for customers and stakeholders, and empowering my team members with my expertise and mentorship.

It seems simple enough: type a URL, hit Enter, and voilà, the webpage loads! 

But behind the scenes, there's a whole chain of processes working together to make that happen. 

Here's a breakdown of the journey a URL takes from your browser to the server and back:

𝗗𝗡𝗦 𝗟𝗼𝗼𝗸𝘂𝗽 : First, your browser checks if it already knows the IP address for the website. If not, it queries the DNS (Domain Name System) to translate the human-friendly URL into a machine-readable IP address.

𝗖𝗮𝗰𝗵𝗲 𝗖𝗵𝗲𝗰𝗸 : Before reaching out to the DNS, your device checks its cache to see if it has the IP saved. If not, it goes through multiple levels (browser, OS, router, ISP) until it gets an answer.

𝗧𝗖𝗣 𝗖𝗼𝗻𝗻𝗲𝗰𝘁𝗶𝗼𝗻 : After getting the IP, a TCP connection is initiated between your device (the client) and the web server using the 𝗧𝗖𝗣/𝗜𝗣 𝟯-𝗪𝗮𝘆 𝗛𝗮𝗻𝗱𝘀𝗵𝗮𝗸𝗲 (SYN, SYN-ACK, ACK). This handshake ensures a stable connection for data transfer.

𝗛𝗧𝗧𝗣 𝗥𝗲𝗾𝘂𝗲𝘀𝘁 : With the connection established, your browser sends an HTTP request to the server, asking it to serve up the webpage.

𝗦𝗲𝗿𝘃𝗲𝗿 𝗥𝗲𝘀𝗽𝗼𝗻𝘀𝗲 : The server processes the request and sends back a response, which includes the status code (e.g., 200 for success, 404 for not found) and the requested data (HTML, CSS, JavaScript).

𝗥𝗲𝗻𝗱𝗲𝗿𝗶𝗻𝗴 𝘁𝗵𝗲 𝗪𝗲𝗯𝗽𝗮𝗴𝗲 : The browser takes over again to process and render the data received:
   - 𝗣𝗮𝗿𝘀𝗶𝗻𝗴: HTML is parsed into the DOM tree, CSS into the CSSOM tree, and JavaScript is processed.
   - 𝗥𝗲𝗻𝗱𝗲𝗿𝗶𝗻𝗴: The browser engine works with the render engine to paint each part of the webpage onto the screen.

This entire process happens in milliseconds, allowing you to experience a seamless web browsing experience!

𝗪𝗵𝘆 𝗜𝘁 𝗠𝗮𝘁𝘁𝗲𝗿𝘀: Understanding this flow is crucial for web developers, network engineers, and anyone working in tech. Optimizing any step along this path can drastically improve load times and user experience.

👉 Save this post for future reference and feel free to share it with anyone looking to deepen their understanding of web fundamentals!

Brij kishore Pandey

Let’s dive into forward proxy vs. reverse proxy—two concepts often confused but with distinct purposes:

1. 𝗙𝗼𝗿𝘄𝗮𝗿𝗱 𝗣𝗿𝗼𝘅𝘆: A forward proxy server sits between a client (like a web browser) and the internet. It acts as an intermediary for requests from the client seeking resources on other servers. Here’s how it works:
   - 𝗣𝗿𝗶𝘃𝗮𝗰𝘆 & 𝗔𝗻𝗼𝗻𝘆𝗺𝗶𝘁𝘆: Users can hide their IP addresses and locations by routing through the proxy, which can mask their identity.
   - 𝗖𝗼𝗻𝘁𝗲𝗻𝘁 𝗙𝗶𝗹𝘁𝗲𝗿𝗶𝗻𝗴: Often used by organizations to block access to certain sites or monitor employee internet usage.
   - 𝗖𝗮𝗰𝗵𝗶𝗻𝗴: Speeds up access to frequently visited websites by storing copies of web pages, saving time and bandwidth.
   - 𝗘𝘅𝗮𝗺𝗽𝗹𝗲 𝗨𝘀𝗲 𝗖𝗮𝘀𝗲: A company implementing a forward proxy for employees to access the internet, with controls to monitor or restrict certain websites.

2. 𝗥𝗲𝘃𝗲𝗿𝘀𝗲 𝗣𝗿𝗼𝘅𝘆: A reverse proxy sits between the internet and a web server, forwarding client requests to the appropriate backend server. Its purpose is quite different:
   - 𝗟𝗼𝗮𝗱 𝗕𝗮𝗹𝗮𝗻𝗰𝗶𝗻𝗴: It can distribute incoming traffic across multiple servers, improving performance and preventing overload.
   - 𝗦𝗲𝗰𝘂𝗿𝗶𝘁𝘆: Helps protect backend servers by hiding their identities and filtering out malicious traffic.
   - 𝗖𝗮𝗰𝗵𝗶𝗻𝗴 & 𝗖𝗼𝗺𝗽𝗿𝗲𝘀𝘀𝗶𝗼𝗻: Often used to cache responses or compress content to speed up delivery.
   - 𝗦𝗦𝗟 𝗧𝗲𝗿𝗺𝗶𝗻𝗮𝘁𝗶𝗼𝗻: Offloads SSL encryption/decryption to reduce server load.
   - 𝗘𝘅𝗮𝗺𝗽𝗹𝗲 𝗨𝘀𝗲 𝗖𝗮𝘀𝗲: A website using a reverse proxy to route user requests to multiple web servers behind the scenes, improving scalability and uptime.

In summary, 𝗳𝗼𝗿𝘄𝗮𝗿𝗱 𝗽𝗿𝗼𝘅𝗶𝗲𝘀 are used by clients to access the internet with privacy and control, while 𝗿𝗲𝘃𝗲𝗿𝘀𝗲 𝗽𝗿𝗼𝘅𝗶𝗲𝘀 are used by servers to manage traffic and improve security and performance. 

Both are invaluable tools but serve opposite ends of the client-server relationship!

Taplio

Brij kishore Pandey's Linkedin Analytics

's Best Posts (last 30 days)

Want to drive more opportunities from LinkedIn?

Taplio

.css-1jgreyo{background-image:linear-gradient(284deg, rgba(39,43,72,1) 0%, rgba(33,47,183,1) 100%);color:transparent;-webkit-background-clip:text;background-clip:text;}Brij kishore Pandey's Linkedin Analytics

's Best Posts .css-qqfgvy{font-size:var(--chakra-fontSizes-md);}(last 30 days)

Want to drive more opportunities from LinkedIn?

Brij kishore Pandey's Linkedin Analytics

's Best Posts (last 30 days)