Skip to content

Set Bibliography Index page to noindex - #345

Open
stumbo wants to merge 1 commit into
mainfrom
bs31_improve_bib_search
Open

Set Bibliography Index page to noindex#345
stumbo wants to merge 1 commit into
mainfrom
bs31_improve_bib_search

Conversation

@stumbo

@stumbo stumbo commented Aug 21, 2026

Copy link
Copy Markdown
Member

Search results currently favor the bibliography index page listing all the items in the bibliography. These changes set this page to noindex, follow instructing robots not to index the page but to index the child pages. This will help surface the individual pages when searches are performed on items covered in bibliographic entries.

  • Add a new tag to the bibliography _index.md page setting it to noindex, follow
  • Add code to head-end.html to recognize front matter tag and inscribe the appropriate value into the generated page
  • Add data-nosnippet around preview text in generated bibliography entries on the index page. This is a secondary change that tells a search engine not to use the preview text in returned results. Given we don't want the page indexed, it may be overkill.
  • Add page level noindex information to sitemap.

Search results currently favor the bibliography index page listing
all the items in the bibliography.  These changes set this page to
noindex, follow instructing robots not to index the page but to index
the child pages.  This will help surface the individual pages when
searches are performed on items covered in bibliographic entries.

- Add a new tag to the bibliography _index.md page setting it to
  noindex, follow
- Add code to head-end.html to recognize front matter tag and enscribe
  the appropriate value into the generated page
- Add data-nosnippet around preview text in generated bibliography
  entries on the index page.  This is a secondary change that tells a
  search engine not to use the preview text in returned results.  Given
  we don't want the page indexed, it may be overkill.
- Add page level no-index information to sitemap.
@interlisp-staging-bot

Copy link
Copy Markdown

Staging preview for this pull request is available at https://interlisp.github.io/Interlisp.staging/pr-345/

@stumbo
stumbo marked this pull request as draft August 21, 2026 03:15
@stumbo

stumbo commented Aug 21, 2026

Copy link
Copy Markdown
Member Author

Setting to draft - looking at the generated html, I'm not sure I got it all right yet.

After a closer look, the no-snippets are where they should be.

@pamoroso pamoroso left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It looks good and I haven't noticed any issues on the staging site.

@stumbo
stumbo marked this pull request as ready for review August 21, 2026 10:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants