Principal AWS Cloud Data Engineer

NorthBay Solutions

Lahore, Punjab
Permanent
Full-time

30 days ago
Apply easily

We're seeking a seasoned Principal Cloud Data Engineer with a track record of 8 to 10 years in the field, with a specialization in AWS, to join our dynamic team of analytics experts. This role presents an exciting opportunity for an individual who thrives on solving complex challenges spanning a diverse array of technologies. If you're someone who revels in experimentation and is eager to push the boundaries of your skills, we want to hear from you.As a Principal Cloud Data Engineer, you'll be at the forefront of shaping and maintaining data analytic roadmaps and infrastructures that closely align with our business and technology objectives. Your innate curiosity and enthusiasm for uncovering insights buried within datasets will be invaluable as you collaborate across functional areas to drive actionable outcomes.Required Skills and Qualifications:

Strong SQL writing skills
Proficiency in Python, PySpark, and Delta Lake is a must
Experience with streaming ingestion using AWS Kinesis
Familiarity with specialized data architecture concepts (e.g., data lake, lake house, data fabric, data mesh, etc.)
Expertise in data engineering on the Amazon Cloud platform
Demonstrated proficiency with AWS services such as S3, Lambda, EC2, Redshift/Redshift Spectrum, Glue, EMR, Athena, MSK, DMS, SSM, EventBus, Lake Formation, SageMaker, etc.
In-depth understanding of data warehousing, data modeling techniques, and ETL processes
Ability to work with large-scale datasets, structured and unstructured alike
Experience in delivering CI/CD and DevOps capabilities in a data environment
Proficient in Jira and Agile development methodologies
Knowledge of industry-wide visualization and analytics tools (e.g., AWS QuickSight, Tableau, etc.)
Strong interpersonal skills and a positive attitude
Openness to learning new technologies and a passion for technology

Responsibilities:

Develop and maintain data pipelines using ETL processes
Ensure adherence to data security, privacy best practices, access control, data versioning, and regulatory compliance within AWS environments
Collaborate with the data science team to implement data analytics pipelines
Work closely with DevOps professionals to deploy AWS-based solutions ensuring reliability, scalability, and performance optimization
Analyze various data stores to derive valuable insights
Explore alternatives for data storing and processing to implement streamlined solutions
Translate business requirements into technical specifications and supervise the implementation of AWS-based solutions
Create and deploy scalable, secure, and efficient AWS architectures to support machine learning initiatives
Effectively communicate with stakeholders, prioritize tasks, solve problems, and build interpersonal relationships

Qualifications:

Bachelor's degree in Computer Science, Engineering, or related field; Master's degree preferred
8-10 years of experience in data engineering with a focus on AWS technologies
Proven ability to work in a team environment and take initiative in problem-solving
Strong analytical and problem-solving skills
Excellent written and verbal communication skills

If you're driven by the challenge of working with intricate data problems and are eager to push the boundaries of your skills in a collaborative environment, we encourage you to apply for this role. Join us in our mission to leverage data analytics for actionable insights and innovation.Powered by JazzHR

NorthBay Solutions