improve parallel copy from local

Description

In the current implementation multiple clients write immediate children (files) of directory in parallel. this increases the performance for large files (files stored on datanodes) only. For small files (files stored in db) this does not improve the performance too much because of the write lock contention on the parent dir (small files are more metadata intensive). This implementation writes files at different levels in parallel which improves the performance

Status

Assignee

Salman Niazi

Reporter

Salman Niazi

Labels

None

Fix versions

Affects versions

2.8.2.8

Priority

Medium