Website Save-On-Foods
Job Description:
As a Data Engineer/Senior Data Engineer, you will deliver pioneering solutions that will disrupt the retail industry using the latest tools and technologies. Each day you will face new challenges and learning is a necessary part of the job – where quantum computing, deep learning and statistical modeling are part of your daily routine.
Job Responsibilities:
- Performing data wrangling, feature engineering, and dimension reduction with data of all shapes and sizes, from parquet files to images
- Leveraging cloud environments and following best practices while building solutions in the data lake as it evolves to meet the needs of the business
- Discovering novel datasets and data sources and making them available for modeling and reporting
- Designing and constructing high-performance, scalable data pipelines to operationalize our state-of-the-art solutions ranging from quantum computing pipelines to deep learning based recommender systems
- Creating innovative solutions to tackle computationally intensive challenges and business issues
- Partnering with Machine Learning Engineers, Data Scientists, and Cloud Architects to deliver models into production
- Using your expertise in big data technologies to champion innovation, design, and implement data-stores and analytic models, oversee large-scale data lake platforms, and design and implement efficient data pipelines from source systems to data-stores
- Coaching, mentoring, and providing feedback to team members and junior data engineers
- Defining and implementing Quality Assurance best practices that support the implementation of data transformations and the availability of high-quality data
- Writing production Python/Scala scripts in a Spark/Databricks environment to support the data pipelines that feed Machine Learning models
Job Requirements:
- Expertise in SQL
- Experience designing and deploying high-performance data processing systems with reliable data validation, monitoring, and logging practices
- Familiarity with software development best practices, including version control, CI/CD and CAB processes
- Rigor in high code quality, automated testing, and other engineering best practices
- Experience with big data technologies such as Hadoop, Spark and Databricks
- A leader with an ownership mindset
- Expert knowledge of databases and modern data workloads
- Able to work independently and as part of a team
- A strong communicator
- Expertise in Python and Spark. Experience in other programming languages such as Java, Scala, or C++ is a plus
- Detail-oriented and organized
- Passionate about machine learning
Job Details:
Company: Save-On-Foods
Job Category: Supermarket
Vacancy Type: Full Time
Job Location: Langley, BC, CA
Application Deadline: N/A
Jobseve.online