Optimization in the Data Lake
When you’re optimizing a data lake, your only metrics are cost and time. You’re working with expensive clusters of worker machines, and can approximate cost as: 1 COST = NUMBER _ OF _ WORKERS * COST _ OF _ WORKERS * TIME Memory/CPU…