The job involves designing, developing, and enhancing the AWS data environment. Responsibilities include setting up AWS Data Platform, building scalable Data Lake solutions, and troubleshooting complex Data Pipelines. It requires expertise in data engineering and leading proofs-of-concept to production.
Company Description
Webtellect is an established software consulting firm. We are equivalent to the finest "custom home builders" as it applies to software. We build software for those companies who have funding but not the resources or for those companies who have the resources but not bandwidth. We analyze, design, develop, test, deploy, maintain, and learn from our engagements to improve for the next. We all share a passion and joy for software excellence. As such, Webtellect consultants are highly coveted.
Job Description
To design, development, and enhancement of our AWS data environment.
Qualifications
- Experience setting up AWS Data Platform – AWS CloudFormation, DevelopmentEndPoints, AWS Glue, EMR and Jupyter/Sagemaker Notebooks, Redshift, S3, and EC2 instances.
- Track record of successfully building scalable Data Lake solutions that connects to distributed data storage using multiple data connectors.
- Must have a background in data engineering – Data Warehouse Development experience would be perfect
- Must have strong skills in SQL, Python, PySpark, and AWS
- Experience in designing, developing, optimizing and troubleshooting complex Data Pipelines using Spark cluster
- Ability to lead proofs-of-concepts and then effectively transition and scale those concepts into production at scale through, engineering, deployment and commercialization.
- Serve as an expert; envision and integrate emerging data technologies, anticipate new trends to solve complex business and technical problems.
Additional Information
Notes:
- 6 month contract.
- ** No 3rd parties. **
- ** No Visas allowed **
Top Skills
AWS
Pyspark
Python
SQL
Similar Jobs
The AWS/Azure Cloud Data Engineer will work with clients to enhance data loading platforms (ETL/data pipelines) and ensure data quality, implement CI/CD pipelines, and manage data migration using AWS services. Collaboration with the Cloud Data Architect is key as well as problem-solving complex SQL and access management issues in various RDBMS environments.
As a Senior Data Engineer at Arcadia, you will design and develop data pipeline connectors for healthcare data integration, manage technical documentation, participate in team projects, code reviews, and scrum ceremonies, while ensuring timely delivery of solutions and collaborating with various internal teams to enhance analytic capabilities.
Be an Early Applicant
The Data Center Selection Manager will enhance the effectiveness and cost-efficiency of colocation sites/PoPs, managing vendor relationships, negotiating contracts, and working with cross-functional teams to support infrastructure growth. This role requires multitasking across various projects and maintaining strong communication with stakeholders.
What you need to know about the Vancouver Tech Scene
Raincouver, Vancity, The Big Smoke — Vancouver is known by many names, and in recent years, it has gained a reputation as a growing hub for both tech and sustainability. Renowned for its natural beauty, the city has become a magnet for professionals eager to create environmental solutions, and with an emphasis on clean technology, renewable energy and environmental innovation, it's attracted companies across various industries, all working toward a shared goal: advancing clean technology.
