Data Engineering involves a lot of systems not just the term "Big Data". What constitute big data are define base upon the customer requirements and needs. Adaptiv solution offers data migration or movements via pipelines and do conversion using open source tools that is available.
What are the common tools we use?
-
Spark
-
Kubernetes
-
Python
-
AWS data pipeline
-
Snowflakes
-
Streamsets
-
Pentaho