Anirban Datta's Linkedin Analytics

Senior Principal Data Engineering Consultant with 18+ years of hands-on experience in defining & implementing data architecture, data pipeline design patterns, data modeling, advanced data processing for Big Data applications and Cloud. Specializing in working with Big Data, ETL/Data Warehouse, Cloud platforms, offering an array of skills in data platform & frameworks, consulting, data governance , defining data requirements and analytics. Experience in multiple domains like Retail, Oil & Gas, Healthcare, Telecom & Travel & Tourism industry. Hands-on experience in end to end life cycle of Data Lake , Data Ocean , Data Warehouse implementation. Currently working on Data Fabric implementation, Cloud Migration, building knowledge graph on data fabric metadata and data lineage. Building MVP products using the new exciting technologies like Generative AI, building LLM powered applications with Microsoft Azure OpenAI services. Below are the tech stack, I have worked on, during different assignments - Azure Open AI, Azure AI Search, Azure Data services, Databricks, Snowflake, Denodo, Neo4j, Spark , PySpark , Spark Streaming, Hadoop , Hive , Impala , Sqoop , Flume , NiFi , Kafka , AWS Analytics Services, SQL , NoSQL , HBase , Cassandra , Solr , Python , Scala , Shell Script, ETL , Informatica , Oracle etc Well versed with data integration, data quality, data virtualization, data catalog, data governance - all dimensions of data ecosystem. A life long learner and distributed computing enthusiast.