Data Engineer – Clean Energy, Downtown Vancouver
Do you want to work with massive amounts of real-time energy data, and the latest technologies in IoT, machine learning, big data, and SaaS?
Come join our client’s Clean Energy Team in their mission to accelerate the adoption of renewable energy and create a more intelligent home!
We are looking for Data Engineers to contribute to their technical vision and to design and build their new cloud data store, and data intelligence pipeline. The software combines intermittent energy sources like solar with residential storage systems to build a reliable, environmentally sustainable electricity grid.
We are looking for folks that are passionate about data, analytics and Big Data … so if that is you, please reach out!
Responsibilities:
As a senior member of the Data Platform team, you will have significant responsibility and influence in shaping its future direction. We are looking for someone to iterate quickly on all stages of data pipeline, including bringing data intelligence products to production.
You should have deep expertise in the design, creation, management, and business use of large datasets, across a variety of data platforms. You should have excellent business and interpersonal skills to be able to work with business owners to understand data requirements, and to build highly scalable timeseries and data lake systems.
Successful candidates will have strong engineering skills and communication, as well as a belief that data driven processes lead to great products. You will need to have a passion for quality and an ability to understand complex systems.
Above all you should be passionate about working with huge data sets and someone who loves to bring datasets together to answer business questions and drive growth.
Requirements:
Bachelor’s Degree in Computer Science or related field
Production experience with various real time streaming technologies (Flink, Spark, Samza, etc.)
Production Experience with Java/Scala and Python
Expertise in developing big data pipelines using technologies like Kafka or Kinesis
Experience with large scale data warehousing, mining or analytic systems.
Experience building scalable infrastructure software or distributed systems for commercial online services
Strong knowledge of SQL and NoSQL data stores
Experience with various AWS services (EC2, S3, Lambda, Kinesis, EMR, Redshift etc.)
Experience with YARN, Kubernetes
Experience with orchestration tools such as Apache Airflow.
What else will you need to be successful?
Background in Machine Learning and productizing Data Intelligence pipelines
Strong communication skills and commitment to teamwork
Sharp analytical abilities and proven design skills
Strong sense of ownership, urgency, and drive
Proven leadership abilities in an engineering environment in driving operational excellence and best practices
The company offers a broad variety of benefits to pair up with a competitive salary. The work environment is bright in new offices in Downtown Vancouver.
Contact: Amanda Du Toit amanda@corporate.bc.ca