What we use
- Public-domain works only. A book is used only if every author, translator and editor whose work is on the page died more than 70 years ago, which makes it public domain in Israel. Books printed in or before 1855 with no known death year are presumed public domain. US status is recorded for each item too (it is not required), so a release limited to items that are also public domain in the US can be built.
- Faithful scans. A faithful photographic or mechanical scan of a printed page creates no new copyright in Israel or the US, so the scan is as free as the book.
- Sources we have no restrictive agreement with.
- National Library of Israel scans marked "public domain, free use";
- public-domain scans fetched from the Internet Archive or Wikimedia Commons;
- texts from Project Ben-Yehuda;
- fonts under the SIL Open Font License.
- What we leave out. Anything under non-commercial or no-derivatives terms, or with unknown terms. That includes National Library of Israel scans marked "public domain, non-commercial use" when fetched from the library's own site or API, unless the library allows otherwise in writing.
- One copy per edition, from an open route. If the same edition is also on the Internet Archive or Wikimedia Commons, we take it from there and record that file as the source. This covers scans made by Google or by the National Library of Israel, because we have no agreement with either of them for files fetched that way.
A record for every item
Before anything is published, every scan gets a rights record generated from evidence, and every line, letter or page cut from it points back to that record. The record gives:
- where the file came from, with its exact URL and checksum;
- who wrote the work and when they died, when and where it was printed, and the sources for each of these;
- who made the scan, such as a library or Google, and any conditions the original holder attached;
- why the item is free to reuse, with a one-line summary.
If a required fact is missing, the item is left out. We credit the National Library of Israel on every item from its collection, and we remove Google's cover pages and watermarks from Google-digitized scans while keeping that fact in the record.
Licences
- Scans, line images and letter images: public domain, marked CC0 1.0. HeOCR claims no copyright in them.
- HeOCR's own data (alignments, annotations, synthetic pages): CC0 1.0.
- Models: Apache-2.0.
- Code: MIT.
- Hebrew Wikisource text, used for evaluation, keeps its CC BY-SA licence.
Takedown
If you believe an item is under copyright or under a binding restriction, please tell us:
- Email heocrproject@gmail.com, or open an issue at github.com/HeOCR/hocrgen/issues. Use the title
Takedown: <item or book id>, and give the legal basis if you know it. - While we look into it, we stop using the affected book and take it out of anything we publish next.
- If it has to go, we publish new versions of the datasets without it and list the removal in a public changelog. Where a platform keeps old versions, such as Zenodo, we ask it to restrict them. Because each item keeps its own record, the rest of the data is unaffected.
The full policy
The policy and its reasoning are public:
The analysis is not legal advice.