Reading/writing compressed and not compressed files in Java
Main reason for this post is trying don’t repeat yourself (DRY) because, often, I fall in the recursive need to read and write compressed and not compressed files (mainly JSON and CSV).
Let’s to see first how to read text files. Note I’m working with (relatively small) text files so:
- The read methods returns an String with the whole content.
- I’m using
BufferedReader
to read line by line.
private String readFile(String fileName) { StringBuilder sb = new StringBuilder(); try { BufferedReader input = new BufferedReader(new FileReader(new File(fileName))); try { String line = null; while ((line = input.readLine()) != null) { sb.append(line); } } finally { input.close(); } } catch (IOException ex) { // Handle exception return null; } return sb.toString(); }
Note: there are more than one way to do things. In the entry Best way to read a text file, where you can find many different ways to read a text file depending on your JDK version and the size of the file.
Similarly to write a String to a file:
private void writeFile(String fileName, String value) { try { FileWriter fw = new FileWriter(fileName); BufferedWriter bw = new BufferedWriter(fw); bw.write(value); bw.close(); } catch (IOException ex) { // Handle exception } }
To read/write compressed files, that is with binary data, we need to work with streams and buffers. So to read a GZIP compressed file and obtain a String:
private String readCompressedFile(String fileName) { try { GZIPInputStream gis = new GZIPInputStream(new FileInputStream(fileName)); ByteArrayOutputStream fos = new ByteArrayOutputStream(); byte[] buffer = new byte[1024]; int len; while ((len = gis.read(buffer)) != -1) { fos.write(buffer, 0, len); } fos.close(); gis.close(); return new String(fos.toByteArray()); } catch (IOException ex) { // Handle exception return null; } }
and similarly to write a String to a GZip compressed file:
private void writeCompressedFile(String fileName, String value) { try { InputStream is = new ByteArrayInputStream(value.getBytes()); GZIPOutputStream gzipOS = new GZIPOutputStream(new FileOutputStream(fileName)); byte[] buffer = new byte[1024]; int len; while ((len = is.read(buffer)) != -1) { gzipOS.write(buffer, 0, len); } gzipOS.close(); is.close(); } catch (IOException ex) { // Handle exception } }
Resources
Next you can find a couple of great links with Java code for various JDK versions:
Reference: | Reading/writing compressed and not compressed files in Java from our JCG partner Antonio Santiago at the A Curious Animal blog. |