Data Engineer

Website Save-On-Foods

Job Description:

As a Data Engineer/Senior Data Engineer, you will deliver pioneering solutions that will disrupt the retail industry using the latest tools and technologies. Each day you will face new challenges and learning is a necessary part of the job – where quantum computing, deep learning and statistical modeling are part of your daily routine.

Job Responsibilities:

  • Performing data wrangling, feature engineering, and dimension reduction with data of all shapes and sizes, from parquet files to images
  • Leveraging cloud environments and following best practices while building solutions in the data lake as it evolves to meet the needs of the business
  • Discovering novel datasets and data sources and making them available for modeling and reporting
  • Designing and constructing high-performance, scalable data pipelines to operationalize our state-of-the-art solutions ranging from quantum computing pipelines to deep learning based recommender systems
  • Creating innovative solutions to tackle computationally intensive challenges and business issues
  • Partnering with Machine Learning Engineers, Data Scientists, and Cloud Architects to deliver models into production
  • Using your expertise in big data technologies to champion innovation, design, and implement data-stores and analytic models, oversee large-scale data lake platforms, and design and implement efficient data pipelines from source systems to data-stores
  • Coaching, mentoring, and providing feedback to team members and junior data engineers
  • Defining and implementing Quality Assurance best practices that support the implementation of data transformations and the availability of high-quality data
  • Writing production Python/Scala scripts in a Spark/Databricks environment to support the data pipelines that feed Machine Learning models

Job Requirements:

  • Expertise in SQL
  • Experience designing and deploying high-performance data processing systems with reliable data validation, monitoring, and logging practices
  • Familiarity with software development best practices, including version control, CI/CD and CAB processes
  • Rigor in high code quality, automated testing, and other engineering best practices
  • Experience with big data technologies such as Hadoop, Spark and Databricks
  • A leader with an ownership mindset
  • Expert knowledge of databases and modern data workloads
  • Able to work independently and as part of a team
  • A strong communicator
  • Expertise in Python and Spark. Experience in other programming languages such as Java, Scala, or C++ is a plus
  • Detail-oriented and organized
  • Passionate about machine learning

Job Details:

Company: Save-On-Foods

Job Category: Supermarket

Vacancy Type: Full Time

Job Location: Langley, BC, CA

Application Deadline: N/A

Apply Here

Jobseve.online