careers
Join our team of experts.
AWS Data Engineer III
340 East 16th Street Charlotte, NC 28206 US
Job Description
AWS Data Engineer III
Duration: 12 months
Location: Hybrid - Charlotte, NC
Core Technical Skills:
- 5+ years of AWS experience
- AWS services: RedShift, S3, EMR, Glue Jobs, Lambda, Athena, CloudTrail, SNS, SQS, CloudWatch, Step Functions, QuickSight
- Experience with Kafka/Messaging, preferably Confluent Kafka
- Experience with EMR databases such as Glue Catalog, Lake Formation, Redshift, DynamoDB, and Aurora
- Experience with AWS data warehousing tools such as Amazon Redshift and Amazon Athena
- Proven track record in the design and implementation of data warehouse solutions using AWS
- Skilled in data modeling and executing ETL processes tailored for data warehousing
- Competence in developing and refining data pipelines within AWS
- Proficient in handling both real-time and batch data processing tasks
- Extensive understanding of database management fundamentals
- Expertise in creating alerts and automated solutions for handling production problems
- Tools and Languages: Python, Spark, PySpark, and Pandas
- Infrastructure as Code technology: Terraform/CloudFormation
- Experience with Secrets Management Platform like Vault and AWS Secrets manager
- Experience with Event Driven Architecture
- DevOps pipeline (CI/CD): Bitbucket; Concourse
- Experience with RDBMS platforms and strong proficiency with SQL
- Experience with Rest APIs and API gateway
- Deep knowledge of IAM roles and Policies
- Experience using AWS monitoring services like CloudWatch, CloudTrail, and CloudWatch events
- Deep understanding of networking DNS, TCP/IP, and VPN
- Experience with AWS workflow orchestration tool like Airflow or Step Functions
Core Responsibilities:
- Where applicable, collaborate with Lead Developers (Data Engineer, Software Engineer, Data Scientist, Technical Test Lead) to understand requirements/use cases to outline technical scope and lead delivery of the technical solution
- Confirm required developers and skill sets specific to the product
- Collaborate with Data and Solution architects on key technical decisions
- Skilled in developing data pipelines, focusing on long-term reliability and maintaining high data quality
- Design data warehousing solutions with the end-user in mind, ensuring ease of use without compromising on performance
- Manage and resolve issues in production data warehouse environments on AWS
Core Experience and Abilities:
- Ability to perform hands-on development and peer review for certain components/tech stack on the product
- Standing up of development instances and migration path (with required security, access/roles)
- Develop components and related processes (e.g., data pipelines and associated ETL processes, workflows)
- Ability to build new data pipelines, identify existing data gaps, and provide automated solutions to deliver analytical capabilities and enriched data to applications
- Ability to implement data pipelines with the right attentiveness to durability and data quality
- Implement data warehousing products thinking of the end user's experience (ease of use with the right performance)
Do you now or in the future require sponsorship (e.g. H-1B)? Y/N
Consulting Solutions and its family of companies is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, disability status, genetic information, protected veteran status, or any other characteristic protected by law.
If you are a person with a disability needing assistance with the application or at any point in the hiring process, please contact us at:
requests@consultingsolutions.com
The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions. While performing the duties of this job, the employee is required to use hands and fingers, reach, climb stairs, walk, sit for prolonged periods of time, talk, and hear. The employee must occasionally lift and/or move up to twenty-five pounds.
Consulting Solutions and its family of companies is an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, disability status, genetic information, protected veteran status, or any other characteristic protected by law.
Share This Job:
Related Jobs:
About Charlotte, NC
Are you sure you want to apply for this job?
Please take a moment to verify your personal information and resume are up-to-date before you apply.