How would you process a 20 gb file with an application only having access to 4gb memory ?

Interview Questions and Answers

Q1. How would you process a 20 gb file with an application only having access to 4gb memory ?

Ans. Load the file in chunks and then process. If we need to do analytic, we can process analytic information for those chunks and then reprocess the processed information from each chunk.

For example - we need to average all marks in the file. We can divide the file and load into 5 chunks and calculate average for each chunk. Then we can collect averages for all 5 chunks and then calculate the final average.

Help us improve. Please let us know the company, where you were asked this question :

_{Like Discuss Correct / Improve bigdata processing big data Asked in 1 Companies}