Requisition ID: 104924
Join the Global Community of Scotiabankers to help customers become better off.
The Team
In partnership with the Customer Insights Data and Analytics teams and our IT partners the Data and Analytics Technology team supports the banks Data and Analytics needs with tooling, projects and IT operational support.
The Role
The Software Engineer role will be responsible for the Platform designing, building, monitoring, tuning, and troubleshooting bank wide initiatives supported by Data and Analytics Technology. This consists of platform building, tooling, integration, process automation, platform enhancement, and delivery of new projects.
Some of the key accountabilities include:
Build Big-Data and Data Science platform and frameworks using Big-Data and Distributed compute technologies.
Participate in and build tools to diagnose and fix complex distributed systems handling petabytes of data & drive opportunities to automate infrastructure deployments, and observability of data services.
Troubleshoot, system capacity, bottlenecks, basics of memory, CPU, kernel, and storage.
Test, monitor, administer, optimize and operate multiple big data clusters on premise and/or in cloud.
Partner with ETL developers in building best practices for Data Warehouse and analytics environment.
Investigate emerging technologies in big data space that relate to our needs and implement those technologies.
Documents and maintains operational procedures and processes.
Maintains effectiveness of data management processes to be complied with bank’s policies and standards.
Understand of change control processes and write change requests.
What You Will Bring to Succeed
4 + years of recent experience in data engineering, handling services in a large-scale distributed systems environment
Exposure to data lineage, meta data management and ETL tools like Collibra/Atlas/IGC, Erwin and DataStage/ Talend / Diyotta
A solid track record of data management showing your flawless execution and attention to detail.
Knowledge of data cleaning, wrangling, visualization and reporting, with an understanding of the best, most efficient use of associated tools and applications to complete these tasks
Experience implementing and using streaming platforms such as SparkSQL, Flink, Kafka, Storm, etc.
Knowledge of Linux operating system internals, file systems, disk/storage technologies and storage protocols and networking stack
Experience with cluster / Grid environment and integration among applications, data (Mulesoft exp is a plus)
Proven knowledge of systems programming (bash and shell tools) and/or at least one scripting language (Java, Python, Ruby, Perl)
Experience with RDBMS and/or NoSQL (e.g. ORACLE, MySQL, PostgreSQL, MongoDB, Cassandra)
Experience with building DevOps/deployment pipelines with Ansible and other related technologies
Experience with Docker or other containerization technologies (Kubernetes e.g.)
Experience in supporting or developing Micro Services, Serverless architecture, Service Oriented Architecture, Web Services, or Data Processing Pipeline
Exposure to working on cloud platforms like Azure/GCP/AWS
Experience with Agile/Scrum development methodologies
Team player with strong communication skills (verbal and written)
Able to see tasks through to completion without significant guidance
Self-managed and results-oriented with sense of ownership is required
Bachelor’s degree or better in Computer Science, Mathematics or relevant.
The Workplace
We are technology partners who help the business transform how our employees around the world work
We have an inclusive and collaborative working environment that encourages creativity, curiosity, and celebrates success!
You’ll get to work with and learn from diverse industry leaders, who have hailed from top technology companies around the world
We foster an environment of innovation and continuous learning
We care about our people, allowing them to design how they work to deliver amazing results
We offer a competitive total rewards package, including a performance bonus, company matching programs (on pension & profit sharing), and generous vacation
#INTECH
Location(s): Canada : Ontario : Toronto
As Canada’s International Bank, we are a diverse and global team. We speak more than 100 languages with backgrounds from more than 120 countries. Our employees are committed to a superior customer experience and use the Banks six guiding sales practice principles to ensure they act with honesty and integrity.
At Scotiabank, we value the unique skills and experiences each individual brings to the Bank, and are committed to creating and maintaining an inclusive and accessible environment for everyone. If you require accommodation (including, but not limited to, an accessible interview site, alternate format documents, ASL Interpreter, or Assistive Technology) during the recruitment and selection process, please let our Recruitment team know. If you require technical assistance, please click here. Candidates must apply directly online to be considered for this role. We thank all applicants for their interest in a career at Scotiabank; however, only those candidates who are selected for an interview will be contacted.