Shafay A. profile photo

Shafay A.

Lead Data Engineer | Dual Data Scientist | Building Scalable Data Platforms & Intelligent Systems | Gen AI & Advanced Analytics | 7x Certified

Germany
500+ connections
Shafay A. on LinkedIn

Updated 7 months ago

7+

Years Experience

7

Roles

63

Skills

2

Education

About

I bring in the following certifications: DataBricks GenAi Fundamentals HashiCorp Certified Terraform Associate Airflow Certified /DAGAUTH GCP Cloud Engineer and Data Engineer Certificate (ACG) HashiCorp Infrastructure Automation Certification AWS Certified Data Engineer Associate AWS Certified Machine Learning Specialist AWS Certified Machine Learning Associate AWS Certified Solution Architect AWS Certified Cloud Practitioner Specialization in Statistics and Deep Learning & Specialization in Python and Ex. Data Science(2016) I have extensive experience in leveraging a wide range of cloud and data-related services across Amazon Web Services (AWS) and Google Cloud Platform (GCP), alongside proficiency in infrastructure and data orchestration tools. On AWS, I am skilled in using Amazon EC2, S3, EBS, RDS, DynamoDB, and Redshift. My expertise includes machine learning with SageMaker, analytics with Athena, QuickSight, and EMR, as well as data warehousing with Redshift. I ensure robust security using IAM, KMS, and GuardDuty, and have experience with AWS Lambda, VPC, CloudFormation, Amazon Q for natural language querying, and Amazon Bedrock for generative AI applications. On GCP, I have significant experience with Compute Engine, Cloud Storage, Persistent Disk, Cloud SQL, Firestore, and BigQuery. I utilize AI Platform for machine learning and Dataflow and Dataproc for analytics. My security management skills include Cloud IAM, KMS, and Security Command Center. Additionally, I am proficient in using Terraform for infrastructure as code across both AWS and GCP, enabling automated and consistent infrastructure deployment. I have experience with Apache Airflow for orchestrating complex data workflows, DBT (Data Build Tool) for transforming data within data warehouses, and Fivetran for automated data integration. These skills enable me to effectively architect, deploy, and manage comprehensive cloud and data solutions. Cloud: AWS, GCP Tools: Airflow, BigQuery, Cloud Function, AWS Lambda, AWS RedshiftMicrosoft, PowerBi, SAP, dbt Languages: python, SQL

Experience (7 roles)

Orion S.A. · Full-time

Lead Data Engineer

Current

Orion S.A. · Full-time

Feb 2024 - Present · 1 yr 8 mos·Berlin, Germany · Remote

Built a scalable data platform using AWS, Serverless, Snowflake, and AWS Specific tools such as Lambda, Glue, S3, LakeFormation, Data Zones, enabling centralized analytics for manufacturing, operations, and finance teams. Led design and orchestration of end-to-end data pipelines with DBT and Airflow...

Delivery Hero · Full-time

Senior Data Engineer

Delivery Hero · Full-time

Jan 2022 - Jan 2024 · 2 yrs 1 mo·Berlin, Germany · On-site

I have experience in managing and developing data pipelines within cloud services, specifically AWS and GCP. My role includes actively monitoring these pipelines using management tools like Airflow. Additionally, I have expertise in implementing secure and scalable API endpoints to provide access to...

Goldman Sachs · Part-time

Senior Data Engineer

Goldman Sachs · Part-time

Jun 2021 - Dec 2021 · 7 mos·London Area, United Kingdom · Remote

Is this your profile, Shafay?

Claim it to keep it updated or request removal.

Claim or Remove

Education (2)

Concordia University

Concordia University

Jun 2021 - Jan 2023

Activities and societies: contact: [email protected] C01 - Developments in Computer Science C02 - Parallel and Distributed Systems C03 - Image Processing/Pattern Recognition and Graphics C04 - Software Systems and Languages C05 - Information Processing and Management C06 - Scientific Computation and Algorithms C07 - Artificial Intelligence and Human-Machine Communication DROP OUT

Government College University (GCU), Lahore

Government College University (GCU), Lahore

2013 - 2017

Grade: A Activities and societies: Programming, sportsmanship hockey, boxing, basketball, gymnastics 3 semesters : 3.6 CGPA + / 4.0 + (post major semesters :after 4th semester) out of total 8 semesters Programming , developer, Helping Juniors, Developing skills , doing Sports. If You think university matters(than you can pick based on my qualification). EchSee cam

Skills (63)

Team LeadershipMachine LearningProblem SolvingAnalytical SkillsEngineering ManagementData AnalyticsData EngineeringAI AgentsData ScienceData IntegrityAgile MethodologiesCloudAWSAirflowTerraformGoogle BigQueryVertex AILookerGitHubdbtDockerPandasMySQLGoogle CloudSnowflakeLambdaLangChainECSEKSAmazon Web Services (AWS)Team ManagementGenerative AIGoogle Cloud Platform (GCP)Domain ArchitectureCritical ThinkingAmazon KinesisArtificial Intelligence (AI)MLOpsPythonKubernetesHugging FaceTerraformAirflowCloudAWSPythonRangeGoogle CloudEC2RDSDynamoDBSageMakerIAMLambdaVPCCloudFormationCompute EngineMySQLFirestoreBigQueryApache AirflowdbtFivetran
Certifications (2)

Apache Spark Programming with Databricks

Databricks

AWS Certified Data Engineer – Associate

Amazon Web Services (AWS)

Languages (2)
English(Native or bilingual proficiency)English, Old (ca.450-1100)
Volunteer Experience (2)

Software Programmer

Python Software Foundation

Apr 2017 - Jun 2017 · 3 mos

Jarvis AI Intern

Facebook

Mar 2017 - Jun 2017 · 4 mos

Honors & Awards (2)

Best Educational Product Alexa Assistant(Evision)

Issued by Amazon · Apr 2020

Associated with NorthBay Solutions

Coding Geek Junior

Issued by ACM, G.C.U. Lahore · Jan 2014

Associated with Government College University (GCU), Lahore

Frequently Asked Questions

What is Shafay A.'s current role?
Shafay A. is currently working as Lead Data Engineer at Orion S.A. · Full-time.
Where did Shafay A. study?
Shafay A. studied Master's degree, Computer Science at Concordia University. They have 2 education entries on their profile.
What skills does Shafay A. have?
Shafay A.'s top skills include Team Leadership, Machine Learning, Problem Solving, Analytical Skills, Engineering Management. They have 63 skills listed on their profile.
Where is Shafay A. based?
Shafay A. is based in Germany.

Related Jobs

View all jobs →

Other Profiles

Browse all →

Looking for your next role?

Chat with Clera to discover job matches, salary insights, and get a polished AI-generated resume.

Chat with Clera

This profile is based on publicly available information. Shafay is not affiliated with or endorsed by Clera. Privacy Policy