Big Data Administrator

BCS Technology International Pty. Ltd.
Centrum ll, Valero, Makati, Metro Manila
This role spans data management and analytics and is critical in the data discovery process. Has a domain understanding of both the data and the use cases and therefor is responsible for creating common profiles for data elements to facilitate reusability.
 
Role and responsibilities
  • The person responsible for the data elements contained in a data source from an originating system. Is responsible for creating and logging data.
  • Responsible for the maintaining Service Levels on the end-to- end data pipeline. This is an operational role.
  • Oversight and accountability for the installation and management of security systems across the entire organization's network and enforcing compliance to data security, privacy and retention policies and processes
  • Work with existing Data Stewards and Information Security functions at Experian.
  • Build and support Hadoop data sets for a team of highly skilled Data Scientists.
  • Complex data streaming and data processing in Apache Spark & Kafka.
  • Process improvement across the current software engineering methodologies.
  • Work in a DevOps model, across multiple projects simultaneously.
  • Work across traditional Data Warehouse and Big Data eco-systems.
  • Develop front end data visualizations of large, unstructured data sets.
Experience
  • Bachelor degree or higher in software engineering, computer science or in a related field
  • Proven ability to architect and implement high-throughput data pipelines
  • Hands-on experience with Hadoop, ingest tools such as Oozie, Kafka, Flume, Sqoop or Kite.
  • Solid understanding of unstructured data sets and HDFS platforms, Hadoop, HBase, Cassandra etc.
  • Experience generalizing high-throughput Hadoop workflows (e.g. MapReduce, Spark)
  • Experience optimizing HBase
  • Firsthand experience handling petabytes of data
  • Past exposure to advanced numerical methods
  • Understanding of basic principles of data governance
  • Excellent teaming and communication skills required
  • Any experience with statistical analysis software - ideally R
  • Amazon Web Services
Technologies
  • Cloudera navigator
  • Cloudera manager
  • MR
  • Hive
  • Pig
  • Crunch
  • Spark Streaming
  • Impala
  • Search
  • Hue
  • MapR
Good to have
  • Spark
  • Spark MLLib
  • Spark Streaming
  • Kafka
  • SPSS, SAS, Weka, MATLAB
  • Scala, Ruby, C++

Quick Apply

Be careful. A salary that's too high can scare away potential employers.

Point out why you are qualified for this job.


Only files with .doc, .docx, .odt, .pdf, or .rtf extensions less than 900kb are allowed.

BCS Technology International Pty. Ltd.

BCS Technology (BCS) is an award-winning Australian based Professional Services organisation focusing on the provision of quality consulting in the area of Business Intelligence, Data warehouse and Application Development.
 
Founded in 2001, Sydney Australia, BCS has emerged as a leading Professional Services provider, delivering tailored solutions and services to clients throughout the world with over forty customers globally in the areas of Finance and Banking, Airlines, Media and Manufacturing.
 
BCS Technology International is a Technology Consulting firm with offices in Australia, Philippines and India. We service our diverse clients who are located across the globe in countries such as Kuwait, India, Indonesia, Malaysia, Singapore, Philippines, Australia and the USA.
 
Our consulting team can work in conjunction with your organisation to define your I.T strategy, implementation roadmap, and associated programs – maximising organisational data to effectively support strategic goals and priorities.

Learn more at :
http://www.bcstechnology.com.au/

Video

Map