Job Descriptions:
Data/BI Engineer
- Skill Sets/Tools & Technologies – Skill Sets/Tools & Technologies – Python, Pyspark, ETL(SSIS Preferred), SQL Server, Power BI, Autosys JIL, Trade Surveillance Domain Knowledge(Optional but nice to have), Gen AI Tools Exposure(optional and nice to have)
Top Skills:
5+ years combined of:
Top level:
Secondary Skills:
- Pyspark
- SSIS
- AutoSys or equivalent scheduling tool
- Agile/Jira
Detailed Job duties:
- Lead complex technology initiatives within Trade Surveillance Data Engineering team.
- Act as a key participant in developing standards and companywide best practices for engineering complex and large-scale technology solutions for technology engineering disciplines.
- Design, code, test, debug, and document for projects and programs.
- Review and analyze complex, large-scale technology solutions for tactical and strategic business objectives, enterprise technological environment, and technical challenges that require in—depth evaluation of multiple factors, including intangibles or unprecedented technical factors.
- Design ETL packages to move data from various sources preferably from Flat files, ISON, Oracle and experience with FTP and NDM.
- The Beneficiary will be using Python, SQL Server, SSIS, Autosys JIL (Job Information Language) Commands, Agile methodologies, Tableau, Power BI
- The Beneficiary will maintain thorough and accurate documentation on all systems and adhere to testing and documentation standards.
- Ensure that quality standards and procedures are maintained, while also obtaining a thorough understanding of the project's goals and business functionality.
- Help formulate test plans outlining steps required to test systems, using structured analysis and design, and submit plans to management for approval and implementation.