Big Data Architect

We are looking for a Data Architect with creativity and results-oriented critical thinking to meet complex challenges and develop new strategies for acquiring, analyzing, modeling and storing data.

In this role you will guide the company into the future and utilize the latest technology and information management methodologies to meet our requirements for effective logical data modeling, metadata management and database warehouse domains. You will be working with experts in a variety of industries, including computer science and software development, as well as department heads and senior executives to integrate new technologies and refine system performance.

We reward dedicated performance with exceptional pay and benefits, as well as tuition reimbursement and career growth opportunities.

What You?ll Do

Define data retention policies 
Monitor performance and advise any necessary infrastructure changes 
Mentor junior engineers and work with other architects to deliver best in class solutions 
Implement ETL / ELT process and orchestration of data flows 
Recommend and drive adoption of newer tools and techniques from the big data ecosystem

Expertise You?ll Bring

10+ years in industry, building and managing big data systems 
Building, monitoring, and optimizing reliable and cost-efficient pipelines for SaaS is a must 
Building stream-processing systems, using solutions such as Storm or Spark-Streaming 
Dealing and integrating with data storage systems like SQL and NoSQL databases, file systems and object storage like s3 
Reporting solutions like Pentaho, PowerBI, Looker including customizations 
Developing high concurrency, high performance applications that are database-intensive and have interactive, browser-based clients 
Working with SaaS based data management products will be an added advantage 
Proficiency and expertise in Cloudera / Hortonworks 
Spark 
HDF and NiFi 
RDBMS, NoSQL like Vertica, Redshift, Data Modelling with physical design and SQL performance optimization 
Messaging systems, JMS, Active MQ, Rabbit MQ, Kafka 
Big Data technology like Hadoop, Spark, NoSQL based data-warehousing solutions 
Data warehousing, reporting including customization, Hadoop, Spark, Kafka, Core java, Spring/IOC, Design patterns 
Big Data querying tools, such as Pig, Hive, and Impala 
Open-source technologies and databases (SQL & NoSQL) 
Proficient understanding of distributed computing principles 
Ability to solve any ongoing issues with operating the cluster 
Scale data pipelines using open-source components and AWS services 
Cloud (AWS), provisioning, capacity planning and performance analysis at various levels 
Web-based SOA architecture implementation with design pattern experience will be an added advantage