lakeFS Spark Client Enterprise v0.18.0¶
Changelog¶
- Parallelize scanning for very large GC runs
Use Hadoop configuration "lakefs.job.range_read_parallelism" to increase parallelism (defaults to default parallelism; seriously consider increasing this).