Gaurav Rawat's Linkedin Analytics

As a Data Engineer with working in transforming data into growth, I have developed expertise in Hadoop, Hive, Python, Spark, Kafka, SQL, AWS, Databricks, Snowflake, Terraform , Airflow, Kafka, Spark Streaming, CI/CD, data modeling, and data pipeline technologies. • Experience in designing, developing, deploying, debugging and maintaining Big Data pipelines using Hadoop, Apache Spark, Python, SQL, AWS, Airflow and Hive. • Experience in developing high performance and scalable solutions that extract, transform and load Big Data. • Experience developing PySpark Modules using Dataframes API, Spark SQL and their optimization. • Proficiency in writing and optimizing SQL queries. • Experience building and optimizing 'Big Data' Data Pipelines, architectures and datasets involving petabyte and terabyte of data. • Experience in working with unstructured and semi-structured data. Skills: Big Data, Python, SQL, Spark, AWS EMR, Databricks, Snowflake, DBT (Data Build Tool), Hadoop, Hive, Docker, Airflow, CI/CD, Terraform, GitHub, Data Quality, Kafka, Spark Streaming, ETL Development, and Data Warehousing. Feel free to reach out to me at gauravrawat141999@gmail.com