                             ARF

                       Copyright 1996
                            by
                  Bitsafe Computer Services

                  425 S. Bird St. #110
                  Sun Prairie, WI 53590
                  Email: bitsafe@execpc.com
              http://www.execpc.com/~bitsafe/arf

                        All right reserved

-------------------------------------------------------------------


What is Arf?

    Arf is a World Wide Web database search and retrieval agent.

    Arf searches web databases such as Alta Vista, Lycos, and
    Deja News, and retrieves documents that they reference.


How do you use Arf?

    Use your favorite browser to do a preliminary search.
    Then, once you've narrowed down what your search term should
    be, fire up Arf.

    Type in your search term and tell Arf which database to contact.
    Arf contacts that database and tells it to do a search. The
    database sends back lists of web pages (or Usenet posts in
    the case of Deja News). Arf goes out on the Internet, gets
    those web pages, and copies them to your hard disk.


What are the benefits of Arf?

    Get every page.  Arf doesn't forget a single one.
    Save time.       Arf searches faster than any human.
    Save money.      Connect time is reduced to a minimum.

    Do other things while Arf searches for you.    
    View your search results offline - with no network lag.
    Search more than one database at a time
        - by starting several copies of Arf.

    Arf is great for writers and other researchers.


Installing Arf

    1) Put cswsock.vbx in your \windows\system directory.

    2) Put arf3.ini in your \windows directory.

    3) Put arf.exe & Readme in whatever directory you want.

    You are now probably done, but check out the next few
    steps.

    4) Arf needs three additional files to run, cmdialog.vbx,
    commdlg.dll, and vbrun300.dll. If cmdialog.vbx and
    commdlg.dll are NOT already present in \windows\system,
    then put the supplied copies there.

    5) Vbrun300.dll is not included in Arf's zip file because
    of its size and because you probably already have a copy.
    If you don't, it is available from the Arf site at
    www.execpc.com/~bitsafe/arf and from Simtel.net and many
    on-line services and BBSs. Just put a copy of it in
    \windows\system, if necessary.

    6) If you want, you can set an icon to point to Arf by doing:
        "File->New->Program item" in Windows 3.1
        or
        "New->Shortcut" in Windows 95 & NT

    7) Arf uses a configuration file to save your favorite settings
    (see below). By default this file will be named
    c:\windows\arf3.ini. You can change this, if you want, by
    inserting a line like:

        set ARFCONFIG=c:\my_dir\my_config_file

    in your autoexec.bat file, but this isn't required at all.


Using Arf

    First make sure you are connected to the Internet.

    Type a search term in the text box labeled "For:" (try
    the word "bitsafe"). Then choose your database in the
    box just above it (or leave it at Alta Vista). Then press
    the "Start" button. The Start button will change into a
    Stop button, and you should start to see informational
    messages appearing in the "Messages" box near the bottom
    of Arf.

    When Arf has finished, take a look in the directory
    "c:\arfout". You should see several files named:
    page1.htm, page2.htm, etc. These are the html pages that
    Arf fetched from the Internet. You can look at these using
    any editor or by using a web browser such as Netscape or
    Explorer.

    You will also find two other files in c:\arfout:
    "fetched.htm" and "badlinks.htm". Fetched.htm is an html
    file that Arf created. It has html links in it that point
    to the "page.htm" files. Try looking at it with your
    browser and clicking on the links - you can view all the
    web pages that Arf fetched very easily. You can tell Arf
    to use another name for fetched.htm in the
    "Name of fetched.htm file" box.

    The file badlinks.htm contains links to web pages that
    Arf was unable to fetch (this can happen when a web
    server is down or when the location of a web page has
    changed, but the link to it has not). You can try viewing
    those pages at some other time.

    At the bottom of each fetched page is a link labeled
    "original page". If you click on the link and are still
    connected to the Internet, you can view the original page
    complete with graphics (Arf does not copy graphics).
    You can tell Arf to put the "original page" link at the
    top of the page instead by using the
    "Placement of 'original page' link" box.

    If you now do another search with Arf, you will find
    that Arf places more web page files in c:\arfout
    without deleting or overwriting the web pages produced
    by your first search. In addition, Arf adds new links
    in the fetched.htm file without destroying the old
    links.

    If you want Arf to put its results in some other
    directory, then change the text box labeled "Directory:".
    If you want to change the names of the pages that Arf
    fetches, change the text box labeled "Prefix:".
    NB: Filename prefixs under Windows 3.1 can only be 8
    characters long - Arf truncates the prefix, if necessary,
    under 3.1)

    The "Max Links" box on Arf limits how many pages Arf can
    look for on each search. The free version of Arf is
    limited to just ten links. The registered version can do
    10,000 links.

    Some pages out on the web are enormous. You can limit
    how many bytes of a page Arf will download by using
    the "Bytes per page"" box. It limits how many bytes
    of a page will be copied to your disk drive.

    When Arf is doing a search, it has to wait for the
    database it is searching to respond with data. You can
    tell Arf how long to wait before breaking contact and
    maybe trying again. You do this by setting the Database
    Timeout text box to the number of seconds you want it
    to wait. Similarly, you control how long Arf will wait
    for a web server to deliver a web page by setting the
    Pages Timeout text box.

    You can have Arf not fetch some of the pages it encounters
    by setting the "Skip links" text boxes. For example, to
    have Arf skip the first ten pages set the "From:" box to
    1 and set the "To:" box to 10.

    As Arf operates, it tells you how things are going in the
    "Statistics" text boxes. The "Links followed:" box tells
    you how many database links Arf has followed. The
    "Pages fetched:" box indicates how many of those links
    Arf was able to follow and successfully retrieve a web
    page.

    Arf has another way to tell you what is doing. Just above the
    Start button is a green square. When Arf is talking to a
    database, this square becomes red. When Arf is busy fetching
    a web page this square becomes blue. When the square is blue,
    you can use your mouse to click on it. This causes Arf to
    quit trying to fetch that page and go on to the next one.
    This is referred to as skipping a page. If Arf has managed
    to transfer part of a page, it will not delete what it has
    managed to get. You can, of course, press the Stop button
    at any time to have Arf terminate a search completely.

    One quick note and then we'll move on to some of the more
    advanced facilities in Arf: When you type a search term in
    the "For:" text box, you have to use the syntax of the
    database you are going to connect to. You can find out what
    these syntax rules are by using a browser to contact the
    database.


Advanced usage

    Arf has the ability to start your favorite browser when you
    press the "Browser" button, but first you have to tell Arf
    where your browser is. Press the menu "File->Select browser".
    This creates a popup box which you use to find your browser.
    When you have located it, press the "Ok" button. Now, do a
    search. When the search is done, press the "Browser" button
    and your web browser will start up. If your browser is the
    one from Netscape, your browser will try to load fetched.htm
    automatically!

    Another thing you can do is to change Arf's appearance to suit
    your own taste in colors. Use the "Color" menu to set the
    colors of Arf's text boxes, the colors of the frames that the
    text boxes are in, and the overall background color of Arf.

    After you have told Arf about the location of your browser
    and set a few colors, be sure to save your settings by using
    the "File->Save configuration" menu. Arf will save your
    settings in the file "c:\windows\arf3.ini" and use those
    settings the next time you use the program. If you'd rather
    have Arf put this information in another file, then edit in
    your autoexec.bat file so that it has a line like:

        set ARFCONFIG=c:\my_dir\my_config_file

    (You will have to reboot for this to take effect).

    Arf saves the following information in its configuration file:
        Arf's screen location
        the current web database
        the current search term in the "For:" box
        the "Skip links" textbox settings
        the web page directory and prefix settings
        the database and web page timeout settings
        maximum number of pages to fetch
        the name of "fetched.htm"
        maximum number of bytes in a fetched page
        where to put the 'original page' link
        the location of your web browser
        and all your color settings.


    That's about it. Arf is not hard to use. If you like Arf, then
    tell other people about it and upload the free version to a
    local bulletin board. Please do not pirate the program. Hope
    you enjoy using Arf.

New

    Starting with version 3.0, Arf now uses data from the
    configuration file, arf3.ini, to guide it in parsing responses
    from web databases. This means Arf will not go out of date
    just because a database changes the form of its output.
    It also means that Arf will be able to deal with new
    databases as they come online.

    When a new database appears or an old one changes, the
    configuration file will have to change. The latest configuration
    file will be on Arf's web page at www.execpc.com/~bitsafe/arf.

Proxy servers

    Some sites use a proxy server as a firewall to protect their
    internal network. Starting with version 3.1, Arf can deal with
    proxy servers. Click on the "Proxy" menu. A popup box appears
    where you can enter the address of your proxy server. Click on
    the "Use proxy" check box and you are ready to start searching.
    Be sure to save your settings by using the
    "File->Save configuration" menu.

New in 3.2

    A new options menu popup has three check boxes that let you:

        write links - 
            Tells Arf to write all the links it receives from a database into
            a file named links (in the same directory where your downloaded
            pages are written).

        write pages -
            Tells Arf whether or not to actually follow links and download
            pages. By turning "write links" on and "write pages" off, you
            can have Arf run a query and just dump the links it finds to
            the links file. This is a fast operation. You can then feed these
            links into other software programs.

        adjust image links -
            Tells Arf to parse pages as they are being downloaded, looking
            for hypertext links to images. The links are adjusted so that
            they point back to the original locations of the images. This
            allows you to view your downloaded files with graphics if you
            are online and your browser is set to autoload images. Also,
            due to the caching nature of browsers and/or proxy servers,
            it enables you to see the graphics when you are off line,
            if you have previously visted that site.