- Designing and contributing to the implementation of complex algorithms.
- Complex data engineering pipelines
- Responsible for implementing Scala solutions on Hadoop (Spark) and GraphX (Spark GraphDB), development of Elastic Search components may also be required. The role will require working closely with Project Managers, Technical Leads, Data analysts, server and web developers, QA engineers, and Business Analysts throughout the project lifecycle.
- The scale of the system, complexities of social network building, data quality, changing financial crime landscape
- Data science/engineering background
- Development experience in Scala, Hadoop, Spark
- Strong development experience in big data processing systems
- Provide prioritization, planning, estimating, work assignments, quality assurance
- Identify and develop the Technical Design documents. Develop and document high level
- Provide training, guidance, assistance, and knowledge transfer among team members.
- Perform other duties as assigned. Overall a good general technical knowledge.
- Experience in social network analysis
- Experience on Google Cloud Platform
- Skilled at generating actionable insights from data
- Strong mathematical background
- Developing, iterating and production sing complex data models
- Scala, Spark
- Big Data/Hadoop/Parallel Processing
- Excellent communication skills
- Ability to navigate a complex organization.
- Ability to be self-directed/motivated.
- Keen to learn new skills and approaches. Inquisitive nature.
- Excellent organization skills and capability to manage multiple parallel activities.
- Strong problem solving and analytical skills
- Any SNA system e.g. SAS Fraud Framework, Palantir, Wynyard, Detica Netreveal
- Elastic Search
- Java
- Elastic Search/Lucene
- Big Data
- MongoDB/CouchDB
- Hive/Impala/SparkSQL
- Sqoop/Flume
- Streaming
- Python, R
- Google Cloud Platform