Use Tika's detected MIME type instead of ArchiveRecord getMimeType.

[ruebot]

GitHub issue(s): #342

What does this Pull Request do?

• Move audio, pdf, and video DF extraction to tuple map
• Provide two MimeType columns; mime_type_web_server and mime_type_tika
• Update tests
• Resolves Use Tika's detected MIME type instead of ArchiveRecord getMimeType? #342

How should this be tested?

• TravisCI
• I did the same tests for Add Audio & Video binary extraction #341 and got the same number of files before and after for the 10 GeoCities WARCs:

4809 audio files
644 PDF files
232 video files
5685 total

Times were slightly slower 🤷‍♂️

• This PR 4212.43s user 224.14s system 623% cpu 11:51.81 total
• HEAD on master now: 3899.34s user 186.65s system 598% cpu 11:23.12 total

Interested parties

@jrwiebe @ianmilligan1

[codecov]

Codecov Report

Merging #344 into master will increase coverage by 0.28%.
The diff coverage is 60%.

@@            Coverage Diff            @@
##           master    #344      +/-   ##
=========================================
+ Coverage   74.91%   75.2%   +0.28%     
=========================================
  Files          39      39              
  Lines        1216    1230      +14     
  Branches      224     224              
=========================================
+ Hits          911     925      +14     
  Misses        214     214              
  Partials       91      91

Impacted Files	Coverage Δ
src/main/scala/io/archivesunleashed/package.scala	80.38% <60%> (+1.4%)	⬆️

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 54c0c3e...47612ce. Read the comment docs.

[ianmilligan1]

Tested locally on sample data and worked nicely on my end. Same results as in #341 as well.

[jrwiebe]

I tested with a sample from the CPP dataset, using the script from #341 and modifying the paths. It worked as expected, but especially on video there were a lot of files with no extension. (Also a few with extensions like ".php".) A strategy for extensions like I describe in #343 would fix this.

[ruebot]

@jrwiebe yeah, I've noticed that the majority of missing extensions so far have been video files. My guess is that it's mostly to do with streaming.