Hi everyone,

I am the original author of Searx. I started Hister with a similar motivation: reducing our dependence on external search engines while keeping searches and personal data under our control.

Searx is a metasearch engine that forwards queries to other search providers. Hister takes a different approach. It builds a private full text index from content you choose, then searches that index entirely on your own infrastructure.

Hister can automatically index pages through its Firefox and Chrome extensions. It can also watch local directories, import browser history and bookmarks, index individual URLs, and crawl complete documentation sites.

The feature I find most useful is offline previews. Hister stores the readable content and HTML of indexed pages locally. You can open a result in a clean and sanitized preview beside the search results without visiting the original website again.

Some other features:

  1. Full text search across web pages, PDFs, docx files, Markdown, OrgMode and text files
  2. Phrase searches, field filters, date filters, wildcards, negation, aliases, labels, facets, and result priorities
  3. Optional semantic search using an embeddings endpoint you configure
  4. Persistent website crawls
  5. Imports from browser history, Linkwarden, Karakeep, Shaarli, Wallabag, and Linkding
  6. Web, terminal, command line, HTTP API, and MCP interfaces
  7. SQLite and PostgreSQL support, plus optional multiple user hosting

Hister cannot replace a global search engine (yet) for subjects you have never encountered because it only searches what you have indexed. My workflow is to search Hister first, then use its shortcut to fall back to traditional search when I need broader web results.

The project is free software under the AGPLv3+ license. It can be installed as a standalone binary or with Docker.

Project: https://github.com/asciimoo/hister

Website and documentation: https://hister.org/

Small read-only demo: https://demo.hister.org/

I’d appreciate feedback, questions, and suggestions as well as joining our growing community.

AI disclosure: AI assisted contributions are not strictly prohibited, but all contributions should be made by humans. More details: https://github.com/asciimoo/hister/blob/master/CONTRIBUTING.md#ai-policy

  • asciimoo@lemmy.mlOP
    link
    fedilink
    English
    arrow-up
    7
    ·
    7 hours ago

    The summary has numerous inaccuracies. Most importantly: it is pretty easy to delete content by topic or age. The hister delete command can accept a search query to remove only matched documents. The same is true on the web UI “actions -> remove all matching documents”. You can quickly filter by age, simply query updated:>365d. Combine it with URLs, labels, domains or phrases.

    • SuspiciousCarrot78@aussie.zone
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      2
      ·
      7 hours ago

      Excellent - thanks for clearing that up.

      Is there a TTL / max database size per user setting? Say I have 4 users using the server; can I allocate a hard limit of 10GB per user, with 180 day retention rules?

      Additionally, is the other parenthetical information materially correct? If not, which points [1 thru to 7] are wrong?

      I would like to further recommend Hister but your documentation is somewhat confusing at first blush.

      • asciimoo@lemmy.mlOP
        link
        fedilink
        English
        arrow-up
        3
        arrow-down
        1
        ·
        6 hours ago

        Is there a TTL / max database size per user setting?

        As I wrote, you can simply automate deletion by document age. Schedule a delete event on each day with the desired retention time defined as a filter expression. Database size limit isn’t available yet.

        Additionally, is the other parenthetical information materially correct? If not, which points [1 thru to 7] are wrong?

        No, sorry, I don’t have time to correct a copy of a multiple screens long AI prompt.

        I would like to further recommend Hister but your documentation is somewhat confusing at first blush.

        Which parts are confusing?

        • SuspiciousCarrot78@aussie.zone
          link
          fedilink
          English
          arrow-up
          1
          arrow-down
          6
          ·
          edit-2
          6 hours ago

          I am happy to narrow it further.

          The point is that you came here specifically to invite questions and feedback.

          I took the time to read the documentation, ask ChatGPT to summarise what I found, and then reduced my follow-up to a simple request:

          «Which of points 1–7 are materially wrong?»

          That is not the same as asking you to audit “multiple screens” of AI output.

          If the answer is “2 and 5 are incorrect”, or even “I do not have time to review it”, that is perfectly fine.

          However, dismissing it as “a multiple screens long AI prompt” does not only not answer the question, it comes off as abrasive.

          As for the documentation, the confusing parts are exactly those I listed: retention, lifecycle management, browser ingestion, storage limits, deletion, multi-user behaviour, and, most importantly, what Hister actually is and who it is for.

          What’s disappointing is not that you disagreed with the AI summary. AIs are idiots.

          It that after inviting questions and feedback, your response to a genuine attempt to understand the project is curt dismissal.

          The inner workings of Hister may be obvious to you; they are not obvious to others.

          “TL;DR” does not encourage the sort of community engagement you ostensibly came here to seek.

          • asciimoo@lemmy.mlOP
            link
            fedilink
            English
            arrow-up
            4
            arrow-down
            1
            ·
            5 hours ago

            However, dismissing it as “a multiple screens long AI prompt” does not only not answer the question, it comes off as abrasive.

            I think it is more abrasive to copy/paste a poorly formatted LLM output instead of taking the time and summarizing it to a few sentences just as you did in your previous post.

            • SuspiciousCarrot78@aussie.zone
              link
              fedilink
              English
              arrow-up
              1
              arrow-down
              5
              ·
              edit-2
              5 hours ago

              That is not what happened.

              I fed your GitHub repository to a clanker because the documentation did not answer my questions. I then shared its summary here.

              You replied afterwards and said the summary was wrong. Fair enough. I then asked which specific points were wrong.

              You could have answered, declined, or ignored the post.

              Instead, you deigned only to dismiss the effort, then blamed me for objecting.

              You also asked which parts were confusing, although my previous reply had already listed those issues.

              You did not address them then, either.

              A prospective user should not need ChatGPT, a cloned repository, and several follow-up questions to understand key functions.

              You invited feedback. Your documentation remains unclear on several points, including issues beyond those I listed.

              Your responses show that further feedback is not worth my time.