selectolax

• Add the scripting option to LexborHTMLParser, which parses <noscript> the way a browser with scripting enabled does: its content becomes raw text, so a <noscript> in <head> no longer pushes the head elements after it into <body>. The default is unchanged.
• Add template_fragments() for reaching the content of <template> elements which are ignored by HTML5 compliant parsers.
• Do not replace <-undef> it not longer possible to get it.
• The internal <html> wrapper of an HTML fragment is no longer reported as the parent of the fragment's top-level nodes.
• create_tag() no longer returns None for the tags whose start tag the HTML parser drops (html, head, body, caption, col, colgroup, frame, frameset, tbody, td, tfoot, th, thead, tr).
• Fix inner_html covering only the first top-level node of an HTML fragment.
• Improve the speed of comment extraction
• Improve the speed of len(attrs) by counting the attribute list directly
• Fix encoding initialization when encoding=True.

This release contains breaking changes. It focuses on speed improvements and corner cases.

The main change is that the Modest backend is no longer available. It is outdated and unmaintained since 2021, contains bugs, and does not follow modern HTML5 standards. We have supported the Lexbor backend since 2021, and we have recommended it for more than 3 years. It gets updated every month and follows all the modern HTML5 standards while being faster on a lot of tasks.

The second is that parse_fragment() is gone. It re-implemented fragment parsing by guessing whether the input was a document or a fragment; LexborHTMLParser(html, is_fragment=True) already does this properly, so the guessing layer has been removed.

The rest of the changes fix corner cases where the bugs were happening rarely, usually when heavily modifying the tree.

• Breaking: Remove the Modest backend. selectolax.parser is now a stub that raises ImportError on import. Use the lexbor backend (from selectolax.lexbor import LexborHTMLParser) instead.
• Breaking: Remove parse_fragment().
• Breaking: Fix css_matches and any_css_matches missing matches outside the first top-level node of an HTML fragment. They now search the same scope as css.
• Breaking: Fix tags and strip_tags doing nothing on an HTML fragment. tags returned an empty list and strip_tags removed nothing, because the fragment was not reachable from the document node.
• Breaking: Fix the internal <html> wrapper of an HTML fragment being reported as a match.
• Breaking: Fix scripts_contain and script_srcs_contain missing matches outside the first top-level node of an HTML fragment. They now search the same scope as css.
• Breaking: Fix scripts_contain and script_srcs_contain answering from another scope's cached result. The cache is keyed by the node the search is rooted at rather than the node it was called on.
• Breaking: Fix select() missing matches outside the first top-level node of an HTML fragment. It now searches the same scope as css.
• Breaking: Fix traverse() covering only the first top-level node of an HTML fragment, and yielding nothing when the fragment starts with a text node.
• Breaking: Fix attribute_longer_than and any_attribute_longer_than returning inconsistent results
• Breaking: attributes and attrs now report an attribute's qualified name instead of its local name. An element carrying both href and xlink:href used to collapse them into a single href key.
• Breaking: Fix iter() skipping the remaining children when a node is removed during iteration
• Breaking: Fix an HTML fragment whose first node is text dropping the rest of the fragment. LexborHTMLParser('a<span>s</span>', is_fragment=True).text() returned 'a' instead of 'as'.
• Fix text() silently returning truncated text instead of raising when a fragment fails to be collected.
• Fix scripts_contain and script_srcs_contain sometimes returning wrong results due to HTML mutations.
• Fix a single undecodable byte in an untrusted document making html, inner_html, html_pretty, attributes, attrs, id, tag, text_lexbor and text_content raise UnicodeDecodeError. Bytes Lexbor passes through verbatim are now substituted with U+FFFD, the way text() already did.
• Fix text_lexbor sometimes holding temporary memory longer than needed
• Improve memory consumption, potential stack overflow and slow extraction in merge_text_nodes(). It is now up to 10 times faster.
• Improve speed of __eq__
• Improve speed of attrs.items() and attrs.values().
• Fix the inner_html setter attaching element children to non-element nodes
• Fix head and body dangling after setting inner_html on the <html> element
• Fix the inner_html setter freeing the replaced children
• Fix root going stale on an HTML fragment.
• Fix a se

• Support lexbor-only builds with --disable-modest
• Importing selectolax no longer automatically imports selectolax.parser and selectolax.lexbor
• Update lexbor

• Add options parameter to LexborHTMLParser to pass Lexbor document parsing options (for example, LexborDocumentOptions.WO_EVENTS to disable mutation events). Fixes #221.
• Fix LexborHTMLParser.clone() losing nodes for empty HTML fragments
• Allow empty elements in text_lexbor. Fixes #220.
• Update lexbor