1. Forum
  2. Usenet
  3. LINUX.DEBIAN.PROJECT

  • Re: Idea: Replace the Directory Import Project with a web-based search

    From David Hedlund@21:1/5 to David Hedlund on Sat Apr 1 15:20:01 2023
    This is a multi-part message in MIME format.
    Debian team: Please read the below information to understand the
    background of this email. Is the Debian Packages Search (https://packages.debian.org/index) (with "*Section: main*") searching
    though *Sources* (extracted from ftp.us.debian.org/debian/dists/Debian11.6/main/source/Sources.gz) ? Or
    are the package entries in *Sources* split into dedicated entries
    designed for the search engine?



    On 01/04/2023 11:53, David Hedlund wrote:


    On 01/04/2023 11:32, David Hedlund wrote:

    Wouldn't it be ideal if we coded a Mediawiki/SMW-compatible search
    engine for the Debian metadata repository files that is operating
    like apt-cache show ?

    This should be the quickest way to update the Directory on a daily
    basis, and we don't even need the Directory Import Project anymore if
    it works. We just need to download the Debian metadata repository
    files like GNU/Linux distros.


    Example with apt-cache show:

    $ sudo apt-cache show yapet
    Package: yapet
    Architecture: amd64
    Version: 2.3-1build2
    Priority: optional
    Section: universe/utils
    Origin: Ubuntu
    Maintainer: Ubuntu Developers <[email protected]>
    Original-Maintainer: Salvatore Bonaccorso <[email protected]>
    Bugs: https://bugs.launchpad.net/ubuntu/+filebug
    Installed-Size: 1424
    Depends: libargon2-1 (>= 0~20171227), libc6 (>= 2.14), libgcc-s1 (>=
    3.0), libncursesw6 (>= 6), libssl1.1 (>= 1.1.0), libstdc++6 (>= 5.2),
    libtinfo6 (>= 6)
    Filename: pool/main/y/yapet/yapet_2.3-1build2_amd64.deb
    Homepage: https://yapet.guengel.ch/
    Size: 296564
    SHA256: a0c697ee25d540e53f8e8285419a6da3896857be96330531a2769502f420ce58
    SHA1: dd1e8153ecd802afbd3e1daf0be7a36b875a385b
    MD5sum: 2c97bd2b178de3171be3bc4b35659196
    Description: Yet Another Password Encryption Tool
     Yapet is a curses based password encryption tool using the Blowfish
     encryption algorithm to store password records encrypted on disk. Its
     primary aim is to provide a safe way to store passwords in a file on
     disk while having a small footprint.
    Description-md5: 1667392a25684f36cc6c3594758eeb8a


    Example output with a Mediawiki/SMW-compatible search engine:

    * Check for new updates of
    ftp.us.debian.org/debian/dists/Debian11.6/main/source/Sources.gz on
    daily basis. Download it if it's new, and extract it. Sources.gz only
    contains a file called *Sources*.

    * With the hypothesized search engine Retrive info from *Sources*
    about the package yapet

    * Format the output like https://directory.fsf.org/wiki/YAPET


    Perhaps it's even possible to combine apt-cache show with a search
    engine. For example, if someone is visiting https://directory.fsf.org/wiki/YAPET

    * With PHP, use https://www.php.net/manual/en/function.shell-exec.php
    to execute apt-cache show (in this case apt-cache show yapet) but
    nothing else -- I know that MediaWiki is preventing you from doing
    this, but perhaps it won't take more development effort than the
    Directory Import Project scripts?

    * Format the output from apt-cache show yapet, so it's looking like
    the current https://directory.fsf.org/wiki/YAPET


    Please leave feedback.


    <html data-lt-installed="true">
    <head>
    <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
    <script data-cookieconsent="ignore" src="moz-extension://8d5afd2c-cd64-4a50-a15d-ec68433b0d5d/content/executor.js"></script>
    </head>
    <body style="padding-bottom: 1px;">
    <p>Debian team: Please read the below information to understand the
    background of this email. Is the Debian Packages Search
    (<a class="moz-txt-link-freetext" href="https://packages.debian.org/index">https://packages.debian.org/index</a>) (with "<b>Section: main</b>")
    searching though <b>Sources</b> (extracted from <a
    class="moz-txt-link-abbreviated" href="ftp://ftp.us.debian.org/debian/dists/Debian11.6/main/source/Sources.gz">ftp.us.debian.org/debian/dists/Debian11.6/main/source/Sources.gz</a>)
    ? Or are the package entries in <b>Sources</b> split into
    dedicated entries designed for the search engine?<br>
    </p>
    <p><br>
    </p>
    <p><br>
    </p>
    <div class="moz-cite-prefix">On 01/04/2023 11:53, David Hedlund
    wrote:<br>
    </div>
    <blockquote type="cite"
    cite="mid:[email protected]">
    <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
    <script data-cookieconsent="ignore" src="moz-extension://8d5afd2c-cd64-4a50-a15d-ec68433b0d5d/content/executor.js"></script>
    <p><br>
    </p>
    <div class="moz-cite-prefix">On 01/04/2023 11:32, David Hedlund
    wrote:<br>
    </div>
    <blockquote type="cite"
    cite="mid:[email protected]">
    <meta http-equiv="content-type" content="text/html;
    charset=UTF-8">
    <script data-cookieconsent="ignore" src="moz-extension://8d5afd2c-cd64-4a50-a15d-ec68433b0d5d/content/executor.js"></script>
    <p>Wouldn't it be ideal if we coded a Mediawiki/SMW-compatible
    search engine for the Debian metadata repository files that is
    operating like apt-cache show ?</p>
    This should be the quickest way to update the Directory on a
    daily basis, and we don't even need the Directory Import Project
    anymore if it works. We just need to download the Debian
    metadata repository files like GNU/Linux distros.<br>
    <p><br>
    </p>
    <p>Example with apt-cache show:</p>
    <p>$ sudo apt-cache show yapet<br>
    Package: yapet<br>
    Architecture: amd64<br>
    Version: 2.3-1build2<br>
    Priority: optional<br>
    Section: universe/utils<br>
    Origin: Ubuntu<br>
    Maintainer: Ubuntu Developers <a
    class="moz-txt-link-rfc2396E"
    href="mailto:[email protected]"
    moz-do-not-send="true">&lt;[email protected]&gt;</a><br>
    Original-Maintainer: Salvatore Bonaccorso <a
    class="moz-txt-link-rfc2396E"
    href="mailto:[email protected]" moz-do-not-send="true">&lt;[email protected]&gt;</a><br>
    Bugs: <a class="moz-txt-link-freetext"
    href="https://bugs.launchpad.net/ubuntu/+filebug"
    moz-do-not-send="true">https://bugs.launchpad.net/ubuntu/+filebug</a><br>
    Installed-Size: 1424<br>
    Depends: libargon2-1 (&gt;= 0~20171227), libc6 (&gt;= 2.14),
    libgcc-s1 (&gt;= 3.0), libncursesw6 (&gt;= 6), libssl1.1
    (&gt;= 1.1.0), libstdc++6 (&gt;= 5.2), libtinfo6 (&gt;= 6)<br>
    Filename: pool/main/y/yapet/yapet_2.3-1build2_amd64.deb<br>
    Homepage: <a class="moz-txt-link-freetext"
    href="https://yapet.guengel.ch/" moz-do-not-send="true">https://yapet.guengel.ch/</a><br>
    Size: 296564<br>
    SHA256:
    a0c697ee25d540e53f8e8285419a6da3896857be96330531a2769502f420ce58<br>
    SHA1: dd1e8153ecd802afbd3e1daf0be7a36b875a385b<br>
    MD5sum: 2c97bd2b178de3171be3bc4b35659196<br>
    Description: Yet Another Password Encryption Tool<br>
     Yapet is a curses based password encryption tool using the
    Blowfish<br>
     encryption algorithm to store password records encrypted on
    disk. Its<br>
     primary aim is to provide a safe way to store passwords in a
    file on<br>
     disk while having a small footprint.<br>
    Description-md5: 1667392a25684f36cc6c3594758eeb8a</p>
    <p><br>
    </p>
    <p>Example output with a Mediawiki/SMW-compatible search engine:</p>
    <p>* Check for new updates of <a
    class="moz-txt-link-abbreviated" href="ftp://ftp.us.debian.org/debian/dists/Debian11.6/main/source/Sources.gz"
    moz-do-not-send="true">ftp.us.debian.org/debian/dists/Debian11.6/main/source/Sources.gz</a>
    on daily basis. Download it if it's new, and extract it.
    Sources.gz only contains a file called <b> Sources</b>.</p>
    <p>* With the hypothesized search engine Retrive info from <b>Sources</b>
    about the package yapet</p>
    <p>* Format the output like <a class="moz-txt-link-freetext"
    href="https://directory.fsf.org/wiki/YAPET"
    moz-do-not-send="true">https://directory.fsf.org/wiki/YAPET</a></p>
    <p><br>
    </p>
    </blockquote>
    <p>Perhaps it's even possible to combine apt-cache show with a
    search engine. For example, if someone is visiting <a
    class="moz-txt-link-freetext"
    href="https://directory.fsf.org/wiki/YAPET"
    moz-do-not-send="true">https://directory.fsf.org/wiki/YAPET</a></p>
    <p>* With PHP, use <a class="moz-txt-link-freetext"
    href="https://www.php.net/manual/en/function.shell-exec.php"
    moz-do-not-send="true">https://www.php.net/manual/en/function.shell-exec.php</a>
    to execute apt-cache show (in this case apt-cache show yapet)
    but nothing else -- I know that MediaWiki is preventing you from
    doing this, but perhaps it won't take more development effort
    than the Directory Import Project scripts?</p>
    <p>* Format the output from apt-cache show yapet, so it's looking
    like the current <a class="moz-txt-link-freetext"
    href="https://directory.fsf.org/wiki/YAPET"
    moz-do-not-send="true">https://directory.fsf.org/wiki/YAPET</a></p>
    <p><br>
    </p>
    <blockquote type="cite"
    cite="mid:[email protected]">
    <p> </p>
    <p>Please leave feedback.</p>
    <p><br>
    </p>
    <lt-container></lt-container> </blockquote>
    </blockquote>
    </body>
    </html>

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)