Bahaipedia:To-do

Below are to-dos for Bahaipedia and its sister and cousin sites, as well as other related sites.

Some to-dos would apply to all wiki sites while others are site-specific.

Whenever relevant, even for content to-dos, consider adding to-dos to the more generic category. If moving site-specific items to their own wikis/pages, be sure to include mention of this there. If something applies only to a specific site, however, move the to-do to that section.

Ongoing to-dos[edit]

Back-up
Waiting on bahai.org/library getting a reliable paragraph API: Update browser add-ons upon new Writings pages (add also for Central Figures themselves?): bahai-reference-library-wiki-overlay and https://addons.mozilla.org/en-US/firefox/addon/bahai-reference-library-wik/ (and for other browsers); see also wiki bot to-do

Content development encompassing Bahaipedia, Bahai.works, Bahai.media, and Bahai9[edit]

Develop, cross-link, and give prominence to sites on core articles and other important topics (and precisely citing sources):
1. Ruhi Institute - http://bahai9.com/wiki/Ruhi
2. Teaching the Faith (like how to teach the Faith, the need for teaching, the current goals, etc.)
3. Education
4. Comparative ethics/religion with Buddhism, Confucianism, Taoism, and others
Sync category structure across all wikis, using bahai.media as a template
Review Bahá'í Writings templates to ensure citations can be built by the main author for each book, and for each link, add a hidden wiki custom web protocol link as per https://bahai9.com/wiki/Template:Wka ; also ensure citations support date and addressee; use Shortcuts as a base.
Document
1. Technical: Ensure all JavaScript mods are well documented
2. Indicate clearly where discussions are taking place and which kinds on which, e.g., http://groups.yahoo.com/group/badi/ for technical discussions not restricted to the wikis, site-specific Facebook groups (at a closed site, but intended for enlisting more editors), RSS feeds (of modifications or new pages) on our respective wikis? (12/25/2021) Note this is taking place mostly on discord now. There was a suggestion to link to it publicly. -David
3. Ensure all docs are accessible via a main docs page
4. Special:RandomInCategory (especially if https://bugzilla.wikimedia.org/show_bug.cgi?id=1497 is implemented for categories to subsume one another hierarchically)
  1. Examples
  2. Potential use for bookmarking, e.g., with "textrand" keyword: http://bahai.works/Special:RandomInCategory/%s
  3. Pending https://bugzilla.wikimedia.org/show_bug.cgi?id=1497 , add each page to a general Scripture or Writings category so people can find all of the Scriptures or go through them randomly? Ensure redirects without diacritics (esp. for use with quick keyword bookmark searches) and ensure subpages like Star of the West issues have their own "Star of the West" category
5. Musical Score extension use with Ogg, MIDI, and scores (as per https://bahai.works/Bahai_News/Volume_1/Issue_4/Text#pg30 ); seeking client-side functionality: https://bugzilla.wikimedia.org/show_bug.cgi?id=60202
  - Note this feature was disabled due to a security bug. Will be re-enabled when it has been resolved. (12/25/2021) Note, it is unlikely to be reenabled due to the technical requirements of doing so. -David
6. Document and encourage cross-linking between sites: http://bahaipedia.org/Star_of_the_West#External_links
7. Document usage of collapsible outlines; see https://bahai9.com/wiki/User:Brettz9/test-collapsibleLists
8. Document interwiki links; possibly incorporate Bahai9's Writings interwiki links on wikis where Writings being quoted
9. Document current back-up procedures, sites covered, etc.

Technical to-dos encompassing Bahaipedia, Bahai.works, Bahaimedia, and Bahai9[edit]

NOTE: Coordinated activities: https://github.com/bahaidev See also: https://github.com/bahaipedia
Admin: See about automating back-ups for all wikis and providing public dump
Inter-wiki integration
1. A federated wiki for shared categories across wikis (like a pingback system), as well as blogs and forums: https://bugzilla.wikimedia.org/show_bug.cgi?id=33373 .
2. Update BADIPagesCreatedLinks to provide and utilize options for caching results to make performance realistic; could also link to (nested) discussion forums on a given topic (with forum software allowing creation if not yet existing); can get some of this behavior with WikiBase; also would ideally have a cross-site editing interface for categories to ensure aligned
3. See also Database -> Wikibase
JavaScript MediaWiki bot (mwbot appears rather good)
1. Auto-add redirects to the wikis (see "shortcut-related")
2. Auto-add bahai.org unique anchor IDs by crawling the site for anchors to map to canonical paragraph numbers (like Kitáb-i-Aqdas, par. 5)?
3. Add in bahai.works goal for adding categories (via templates) accessible on subpages of books for sake of incategory:-reachability?
4. Add protocol code into citation templates for each work (see custom web protocols)
5. See b9 technical to-do related to Hidden Words table population
6. See also document to-dos above for mention of bulk categorizing to-dos; might auto-add templates/categories to subpages to add them to a text category so incategory-based searches (Search category pages) will work.
7. Taps into a SPARQL API (not sure about manipulation though)--potentially useful with Wikibase automation
Shortcut-related
1. Decide (re: section transclusion) whether to use the somewhat more fragile numeric ranges instead of textual cues (Chrome's Text Fragments standard might be informative but not complete for our needs) about exactly which sentences to transclude in order to take advantage of their language-neutral nature. Implement this capability once a good system could be decided on. (Many factors not documented here to be considered.)
  1. Must allow for extraction of specific sentences, ellipses, and bracketed substitutions (if not also table joins and splits) as per new module at http://bahai.works/Module:Extract as demoed at http://bahai.works/User:Brettz9/testingExtractOutline
  2. Expand the above module to handle numbered pars., sentences, words, and characters
  3. Adapt the above module (for both modes) to skip over inner-tag content
  4. Consider placement of outlines/compilations in User namespace (including user-protected option) so users can work independently if they wish (and be discovered?); forking capability would be ideal!
  5. Find a way for extra formatting, links, and even non-standard sectioning to be removed from the Writings at Bahaiworks, enabling such features through external overlays
  6. Create code to facilitating tagging (words/phrases and/or headings) with an ability to either have tags belong to a serial, non-overlapping groupings or to allow overlapping; bi-directional mouse-drag-to-coordinates or coordinates-to-mouse-(or-programmatic)-selection (including for the proposed image map "image text" variety, e.g., to highlight a portion of Bahá'u'lláh original writing to annotate that portion while reading from the image, e.g., to summarize or add individual commentary)
2. Brett: Re: custom web protocols (allowing for linking to the Writings independent of site, so users could choose whether to follow links of the Writings (such as within citations we might auto-create whenever a template was referenced to excerpt from the Writings) to Reflib, to Bahai.works, or wherever someone had created a handler), as appropriate, expand to other wikis beyond B9 to enable https://www.mediawiki.org/wiki/Manual:$wgUrlProtocols and use https://www.mediawiki.org/wiki/Manual:$wgAllowUserCss (or https://www.mediawiki.org/wiki/Manual:$wgAllowUserJs ) to allow users an easy way (without need for creating an extension that adds a user preference or adds inline JS) to hide/show the web protocol vs. normal links; see https://bahai9.com/wiki/Template:Wka and https://bahai9.com/wiki/User:WikiSysop/common.css with https://bahai9.com/wiki/User:Brettz9/web-protocol
  1. At same time as applying the protocol to new templates (and pages), can add shortcuts for books (so can use keyword shortcuts like "b9 ka" to go to the Kitáb-i-Aqdas page of bahai9.com)
3. If the World Centre does not move itself to support traditionally canonical paragraph/page references (e.g., aqdas#par5), we ought to create either redirects, a Lua module, or external script which converts canonical paragraph references to BWC anchor ids allowing us to use interwiki or template links such as {{aqdas|5}} which link to the exact paragraph, making it transparent, easily fixable if the paragraph is input incorrectly, and supporting custom protocols so users can opt to view the page on another site. Probably also want script to convert in other direction so that links found, e.g., on Bahaipedia, can be converted to a traditional canonical-friendly system (instead of requiring all protocols to support their opaque IDs). Started https://github.com/bahaidev/bahai-reflib-data for the external script support, though not yet hosted on any server to be available as a public API.
Database (advantage over mere infoboxes would be allowing querying of large datasets, including without the need of loading all data up front)
1. Resources: https://www.wikidata.org/wiki/Wikidata:How_to_use_data_on_Wikimedia_projects#Direct_access
2. Could have some or all content powered by some external source of data: https://www.mediawiki.org/wiki/Extension:External_Data (usable for transcluding https://bahai-browser.org too????)
3. Run own Wikibase repository and client ( https://bahaidata.org ). This would probably be ideal, but there is a simpler extension to add and query tables, WikiDB (see also its tutorial). Could include links among our sister wikis, Wikipedia, and https://bahai-library.com/tags , http://bahaistories.com/ , Phelps (and could use API for Bahá'í print indexes, see https://bahai-browser.org/indexes/ and https://bitbucket.org/brettz9/bahai-indexes/ )
4. See also "Semantic Result Formats" below and its "Datatables" format
Revisit Semantic Mediawiki to consider potential applications
Semantic Result Formats (or equivalent with Wikibase if/when made possible)
1. Show the most recent (or earliest) date of something, e.g., you could automatically show the page with the latest "Published date" property on the main page or something (and its date).
2. Show properties in a hierarchical list, e.g., for nested "Location of", one could print out a list with say "North America -> United States -> Chicago", showing which pages were available (and queries can be limited, e.g., so it didn't show all locations for the world, just those of interest, with a particular category or property).
3. Datatables, for pagination, filtering of tables, and within-table search
4. Tag clouds to query property values (and limitable to say a particular category) that are most frequently cited; can work with a word cloud which might be interesting on Bahai.works for say making a word cloud of the most frequent words in a Bahá'í text!
5. Charts as well as mathematical results for say getting sums, medians, or minimums of numerical property data, e.g., to find the median national Bahá'í community size.
6. iCal format, e.g., for importing Holy Days. (While it could theoretically be usable for local events, I recall the House letter limiting scope of non-institutional websites to avoid such as a global calendar of events around the world.) They also mention showing dates in a calendar or timeline (though this feature might not be maintained in the latest version). (They do have a working timeseries chart, showing a value over time, e.g., for say number of LSAs in a country.)
Area maps
1. Besides the ImageMap extension, it'd be very interesting to be able to search and display words within a text represented in image form, e.g., for original Tablets of Bahá'u'lláh, or, for English, of Shoghi Effendi, etc. (would be generally useful for calligraphy, including Chinese, etc. as well) I've started a skeleton repo at MapText to which I'd like to see integrated into the likes of https://github.com/naver/ImageMaps for graphical editing of the image maps and then add features to search within an individual text and hover over image areas to get the text. Ideally, there could also be a means of a global search of an index of all such text image documents such that a text search could lead directly to the text image page with its results already highlighted. Could perhaps implement by having the page with the area map also having text tagged within Mediawiki properties which could be queried (though the text content would need duplication, once for the specific area map a word mapped to, and the other for the whole text).
Tools
1. Allow search tool to search within headings only as, e.g., at http://www.bahai.org/library/authoritative-texts/search#content_type=head&query=test
2. Collapsible outlines
  1. Command/button for collapsing/expanding all at a given level or at all
  2. Consider using or adapting NavContent extension with collapsible outline JavaScript
  3. Remember expanded states (could use https://stackoverflow.com/a/14093425/271577 to get a selector for saving in storage and if found, then collapse)
  4. The JavaScript code responsible for collapsed outlines could be optimized and improved to handle definition lists.
3. For independent navigation of side-by-side text + wiki iframe, use srcElement property in a Firefox add-on, noting security/privacy risks if need for escalated privileges by parent frame cannot be obviated (with ability for child iframes to peer into parent or sibling frames)
4. Idea for mediawiki-Popups to be used with https://bahaiconcordance.org/ (or Bahá'í News with Bahaipedia) to display tooltips of definitions (ideally from the dictionary used by Shoghi Effendi that David obtained but has not been able to scan) (or autolink a name, e.g., on Bahá'í News, to Bahaipedia) if a page exists.
5. Idea for independent scrolling of quotations in B9 and reference notes
6. Idea for embedding pdf.js PDF so that can listen for page number changes to load corresponding HTML text alongside the PDF

To-dos for specific projects[edit]

(This section might be moved to the relevant wiki.)

Bahaipedia (http://bahaipedia.org)[edit]

Compilation/Outlining/Editing OR Technical?[edit]

-

Compilation/Outlining/Editing[edit]

Extract important historical details, places and figures from the Bahai.works publications like Bahai World, Bahai News, etc. and use them to fill in Bahaipedia with articles, dates, a more complete chronology, etc.
Documentation
1. Reach out to invite more people to document their Baha'i sites
2. Document assorted available Baha'i software/tools (already on Bahai9.com?)

Bahai.works (http://bahai.works)[edit]

Compilation/Outlining/Editing[edit]

Specific works
1. Check French page of Star of the West
2. Extract all of the images from the rescan of Baha'i News and upload/categorize them on Bahai.media
  - Solicit unfolded, clean copies of missing issues. Complete list here
3. Addition of Year book PDFs
4. To the extent possible, OCR, proof, and format Baha'i News, Baha'i World, World Order, and Year book PDFs, especially Baha'i News given its high number of original authoritative text
5. Build up Messages from the Universal House of Justice 1963-1986 from http://bahai-library.com/uhj_messages_1963_1986 (and return changes)
6. Fix transliteration errors on The Dawn-Breakers, add images
7. Star of the West image cropping, uploading, and referencing; other formatting (large source of some authoritative quotations, and for the sake of easy reading, searching and targeted linking or inclusion in compilations)
Specific categories of works
1. Authoritative compilations from the Baha'i World Centre
2. David: Add other generic materials from the Writings of Baha'u'llah on down to the House and related interesting publications like Revelation of Baha'u'llah, so that in conjunction with the API (or https://bugzilla.wikimedia.org/show_bug.cgi?id=58971 ), Bahai.works can become a simple (ideally, iframe-based) API for other sites (and for blog or forum plug-ins) wishing to transclude ranges from the Writings and to add form support so a specific range, page anchor, and optional styling can be specified through the UI. (12/25/2021) Note, this likely will not happen. -David
Add categories to all subpages of works so that they can be discovered with "incategory:" searches (esp. if technical to-do to add textbox to automate this is added)
Integration of indexes and (copyright-ok) prefatory material at http://bahai-library.com/zamir_temp_indexes along with the Writings.
Page links and image/PDF inclusion
Add explicit paragraphing (or omit) after page breaks so that it can be clear, when a new sentence starts after a page break, whether the new sentence is starting a new paragraph or not. Also can distinguish, e.g., a letter heading which is not indented from a paragraph that is.
Documentation
1. Usage of dotted CSS as per [1]
2. How an older version of http://bahai.works/Star_of_the_West/Volume_2/Issue_1/Text#pg12 (edit source) can demonstrate the multi-column appearance for those who wished to see it: http://bahai.works/index.php?title=Star_of_the_West/Volume_2/Issue_1&oldid=15827#pg12
3. Procedures for protecting pages to ensure all Writings pages are protected from vandalism for confident usage by external third-party APIs (and internal reliability)
  - Possibly using Approved Revs: https://www.mediawiki.org/wiki/Extension:Approved_Revs

Bahai.media (http://bahai.media)[edit]

Compilation/Outlining/Editing[edit]

Bring over content: We were most kindly granted permissions to bring over any and all content (such as its large media collection) from bahai-biblio but now we need to find a way to get it downloaded quickly on our own (and then uploaded). There are tools out there which can bulk download from a site. (12/25/2021) Note, there is such a wide variety of content, I'm unsure if this site has the appropriate permissions to release all these files to us. -David
List of missing publications that we hope to acquire and digitize/categorize on Bahaimedia

Bahai9 (Bahai9.com)[edit]

Admin[edit]

HitCounter for B9 (and other wikis?) and re-enable Special:Popular pages link on main page

Technical[edit]

Create automated script to build individual pages like for each of the Hidden Words, and envelop them into a table as with the Kitáb-i-Aqdas (then add as links to bahai-browser); see Mediawiki Bot to-dos

Compilation/Outlining/Editing[edit]

Ongoing: ensure these are empty LonelyPages, UnusedCategories, UnusedFiles, UnusedTemplates, WantedTemplates, WantedFiles, WantedCategories (wanted pages does not need to be empty); UncategorizedCategories should only have "Fundamental"; also review Bahai9 namespace content (though can't check for orphaned Bahai9 pages)
High-level category clean-up
1. More generic and complete concept-based outline, organized hierarchically and in interconnected fashion (Bahai9 is still lacking in the type of content at http://bahaitext.info/ or http://loom.loomofreality.org/ ).
2. Add categories
3. Make site more user-friendly in appearance and terminology (where possible), e.g., adapting or removing original link lists.
Citing, templates, and redirects
1. Ensure redirects for each Bahá'í Writings page (while looking at templates)
2. Change from interwiki links to Writings to equivalent templates, to avoid possible future language code conflicts, e.g., "pt" for Paris Talks conflicted with "pt" for Portuguese so it could have been changed to {{pt|...}} (note that for historical reasons, this particular example was instead changed to "pta" and should actually be changed back to "pt" since there should be no template with that name).
3. Authenticity degrees; apply across code with light colors; templates for Writings; make color legend page linked from (light dotted border instead of colors); question mark for status; sub-template for Paris Talks depending on original availability; see Template:PartiallyAuthentic and User:Brettz9/test3
Add content from:
1. http://bahaiquotes.com/ (as we were kindly given permission)
2. Important and appropriate material from authoritative sources within published compilations on the LSA (one from the U.S. and one from Australia)
3. House messages regarding the Plans
Utilize Labeled Section Transclusion (see cross-site technical section); integrate with TextBrowser/bahaiwritings?

Other sites[edit]

Bahai-library.com[edit]

Another site for which there may be some coordination or cooperation is http://bahai-library.com whose to-dos are listed at http://bahai-library.com/to_do

Wikipedia[edit]

Any integration?

Wikibase[edit]

See about getting properties added for cross-referencing from Wikibase/Wikipedia to pages on https://bahai9.com , https://bahaipedia.org , https://bahai.works , https://bahai.media , https://bahai-library.com/tags , (indexes, Bibliography, Phelps) etc.

Wikisource[edit]

Complete scores at https://en.wikisource.org/wiki/Bahai_Hymns_of_Peace_and_Praise (utilizing appendix within http://bahai-library.com/pdf/a/armstrong-ingram_music_devotions_OCR-text.pdf )

Proposed sites/software[edit]

Proposed wikis[edit]

Pilgrim's notes
Detailed Bahá'í histories
Q&A
Bahá'í news
Bahá'í dictionary (bahaiwords/bahaiconcordance)
Bahá'í study materials (bahaiversity)
Bahá'í projects/planning
Verse/topic commentaries
Wiki to provide scientific/historical clarity to the Writings

"Study the sciences, acquire more and more knowledge. Assuredly one may learn to the end of one's life!"

(Paris Talks, p. 43)

"Put all your beliefs into harmony with science; there can be no opposition, for truth is one. When religion, shorn of its superstitions, traditions, and unintelligent dogmas, shows its conformity with science, then will there be a great unifying, cleansing force in the world which will sweep before it all wars, disagreements, discords and struggles--and then will mankind be united in the power of the Love of God."

(Paris Talks, p. 146)

Also Indexes, Bibliography, and bahai-library.com/tags would be good candidates for interlinking.

Other sites/software[edit]

Element/Matrix chat rooms tied to verses of the Writings
Specialized Q&A web software; see https://www.biostars.org/ ; see https://github.com/ialbert/biostar-central ; has advantage of allowing links to prepopulated tag (or title or content?) so we could link to it from Bahai9/Bahaipedia pages to prepopulate the topical tag or link to it from Bahá'í Reference Library Overlay or textbrowser/bahai-browser.org to prepopulate a tag for the paragraph number in question.
Ideas for external sites which should have RDF output for Wikibase federated wiki SPARQL support
1. Resources:
  1. For creating a SPARQL endpoints, it would need to follow https://www.w3.org/TR/sparql11-protocol/ (doesn't appear complicated)
  2. Good-looking SPARQL engine to allow for SPARQL queries: https://github.com/Callidon/sparql-engine
    1. Example: https://github.com/Callidon/sparql-engine/blob/master/examples/levelgraph.js
  3. One needs to make own implementation of the engine, however
    1. For building RDF to feed the engine implementation; see https://github.com/rdfjs/N3.js/
    2. See sample RDF XML at https://w3schools.sinsixx.com/rdf/rdf_example.asp.htm
  4. Fetching SPARQL over web https://www.npmjs.com/package/fetch-sparql-endpoint;
  5. Include querying of https://query.wikidata.org/sparql too (with join of b-l data?) and listing of others: https://linkedwiki.com/query/SPARQL_endpoints_in_Wikidata
2. Queryable bibliography, e.g., William Collins bibliography, author permitting. Perhaps we could convert the database into template calls on the wiki (or at least start our own). Maybe the semantic wiki extensions or Wikidata could be used in conjunction with this. Conjoin bibliographies with description of websites. Websites are already being described at Bahaipedia (e.g., http://bahaipedia.org/Bahai.org , http://bahaipedia.org/Bahai9 and http://bahaipedia.org/Bahai-library.com ).
3. Indexes (search of print indexes for topical collection); also build for it an index editing system which can allow side-by-side transclusion of index entries (official or user-entered) alongside or as overlay to scriptural text. See http://bahai-library.com/zamir_temp_indexes and https://bitbucket.org/brettz9/bahai-indexes/ ; add more index works
4. AI Bot: Seed, among other sources, with Phelps' questions that are addressed by Tablets

No action for now[edit]

As applied on bahai.works and bahai9, could add a search textbox in category pages, or add a textbox with categories in pull-down to do "incategory:" searches, thereby potentially allowing searches by a particular author, within a particular book, with a particular subject matter, etc.

Rejected to-dos[edit]

(Tracking, so we have a record and don't need to ask again.)

Though one can apply on a personal page, it was felt too distracting to highlight the page when the text was hovered over