package soupault

  1. Overview
  2. Docs
Static website generator based on HTML rewriting

Install

Dune Dependency

Authors

Maintainers

Sources

3.2.0.tar.gz
md5=5ac097e317586ec80395603fc75e5125
sha512=32d885e2f2c2b4f30c76c3f7fd1e1874275290537d6f53303745bc0f9f340fca3688239070b8edc98883b3a7f3522092e5602aa7626ac255f76d708b03e8d7b3

Description

A website generator that works with page element tree rather than text and allows you to manipulate pages and retrieve metadata from existing HTML using arbitrary CSS selectors.

With soupault you can:

  • Generate ToC and footnotes.
  • Insert file content or an HTML snippet in any element.
  • Preprocess element content with external programs (e.g. run <pre> tags through a highlighter)
  • Extract page metadata (think microformats) and render it using a Jingoo template or an external script.
  • Export extracted metadata to JSON.

Soupault is extensible with Lua (2.5) plugins and provides an API for element tree manipulation, similar to web browsers.

The website generator mode is optional, you can use it as post-processor for existing sites.

Published: 22 Oct 2021

README

soupault

Soupault is an HTML manipulation tool. It can be any of:

  • static site generator

  • HTML processor

  • metadata extractor

or all of them at the same time.

Soupault works with the HTML element tree of the page, so it can do many things that traditionally could be done with client-side JS: inject new HTML into existing complete pages, create a table of contents that preserves the id elements of HTML headings and more.

It also doesn't use front matter and extracts metadata from HTML instead, using a CSS3 selector to metadata field mapping, so even hand-written static pages can be indexed rather than treated as assets. For example:

[index.fields.title]
  # Try to find <h1 id="post-title"> if it exists,
  # else use the first <h1> 
  selector = ["h1#post-title", "h1"]

[index.fields.excerpt]
  selector = ["p#post-excerpt", "p"]

[index.fields.date]
  selector = ["time#post-date", "time"]
  extract_attribute = "datetime"
  fallback_to_content = true

Extracted metadata can then be rendered and injected into pages:

[index.views.blog]
  # Insert rendered data into the element that matches "#blog-index" CSS selector.
  index_selector = "#blog-index"
  index_item_template = """
    <h2><a href="{{url}}">{{title}}</a></h2>
    <p><strong>Last update:</strong> {{date}}.</p>
    <p>{{excerpt}}</p>
    <a href="{{url}}">Read more</a>
  """

Soupault is...

  • Eternal: it comes as a statically-linked binary with no dependencies.

  • Extensible: you can bring your own page preprocessors (e.g. Markdown to HTML convertors), pipe HTML elements through external programs, and load Lua plugins.

  • Flexible: most options are configurable and most built-in features can be reimplemented as Lua plugins.

Soupault is named after the French dadaist and surrealist writer Philippe Soupault because it's based on the lambdasoup library.

Visit https://www.soupault.app for details.

For support and discussion, write a message to the mailing list.

Installation

Pre-built binaries are available for Linux, Windows, and macOS. You can download them from https://files.baturin.org/software/soupault and from Github releases (https://github.com/dmbaturin/soupault/releases).

You can verify release archive integrity using this signify/minisign key: RWRfW+gkhk/+iA7dOUtTio6G6KeJCiAEp4Zfozw7eqv2shN90+5z20Cy.

You can also install stable release versions from OPAM:

opam install soupault

Finally, you can build the latest development version with:

opam pin add git+https://github.com/dmbaturin/soupault

Contributing

Bug reports and patches are always welcome. Feature requests and new features are also welcome, but please consider discussing them with the maintainer first.

You can submit patches either as Github pull requests or send them to the Sourcehut mailing list.

Dependencies (18)

  1. lua-ml >= "0.9.3"
  2. tsort >= "2.1.0"
  3. jingoo >= "1.4.2"
  4. base64 >= "3.0.0"
  5. spelll >= "0.3"
  6. odate >= "0.6"
  7. containers >= "3.4"
  8. yaml >= "2.0.0"
  9. ezjsonm >= "1.2.0"
  10. re >= "1.9.0"
  11. fmt >= "0.8.9"
  12. logs >= "0.7.0"
  13. fileutils >= "0.6.3"
  14. otoml < "0.9.2"
  15. markup >= "1.0.0-1"
  16. lambdasoup >= "0.7.3"
  17. dune >= "2.0.0"
  18. ocaml >= "4.08"

Dev Dependencies

None

Used by

None

Conflicts (1)

  1. result < "1.5"
OCaml

Innovation. Community. Security.