FWKCS(TM) Contents_Signature System, Ver. 2.05, 1996 Apr 26. (C)Copyright Frederick W. Kantor 1989, 1996. All rights reserved. New or changed in FWKCS version 2.05: ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ General upgrade and maintenance release, with additions for HTML support under DOS, OS/2, and Windows; improved JPEG JFIF and GIF file handling; more versatile handling of file descriptions; support for use when mapping more than 26 drives; and code revisions for improved performance. Background ~~~~~~~~~~ FWKCS is the premier system for automatically recognizing duplicate files and duplicate zipfiles, independent of filename. It correctly handles zipfiles from multiple platforms, including inner files with long filenames, filenames containing blank spaces, and zipped paths containing up to 126 levels of subdirectories. It is used on major electronic bulletin board systems; quality control is backed by more than 5,000,000 node_hours on giant systems, through which have passed copies of a large fraction of all the different shareware zipfile products that our civilization has seen. FWKCS keeps track of where files are, what they are called, and automatic high_speed identification independent of filename. It is routinely used for blocking duplicate uploads, even when a zipfile is made up of files which are scattered among multiple files and zipfiles on the BBS, or which were in the past on the BBS. In identifying files independent of filename, FWKCS provides a typical statistical pairwise error rate of approximately one part in 1,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000. When used on a network or in a multitasking environment, FWKCS can provide 24_hour_a_day operation with no down_time for maintenance -- all normal maintenance operations, including consolidating the data base etc, are transparent to users; they can be done while the system is up and running and handling traffic. It is even possible to search the system and rebuild the data base while the system is up and running. Series 2.nn includes features to help you protect your system from becoming involved in software piracy. For ease in updating, the anti-piracy resource material for use with FWKCS is being distributed in a companion series, FWKCXnnn.ZIP; that series started with FWKCX001.ZIP, issued 1995 Jan 16 (note: that series number is not tied to the FWKCS version number). This resource material allows you to use powerful FWKCS features for the automatic recognition and automatic blocking of files, independent of filename. For where to get the most recent release, see "Note 2:" near the end of README.TXT. The executable code needed, is provided in this package (FWKCS205.ZIP). See especially XCLEANUP.BAT and FLAG_REV.BAT (both are automatically installed in your \CS directory; for on_line help in your \CS directory, while in that directory do CSM ). ------------------------ For current users, below is a summary of what is new or changed in FWKCS(TM) Version 2.05. This release includes a program (REPLACE.BAT) which lets you replace your existing, working version of FWKCS, Ver. 1.12 or later, while keeping your working CS lists, logs, special messages, and configuration. Changes in FWKCS.EXE: ~~~~~~~~~~~~~~~~~~~~~ 1. Added /1 option t to Trim contents_signatures output so that they do not contain drive\path information; this assures that the output will fit within an 80 column wide window, for subsequent copy and paste. 2. Added /1 option u(1) : u paUse at end of output until a key is pressed. This assures that contents_signatures displayed in one window can remain available for copying and pasting into another window. For example, this can be used in filling in a form in HTML for communicating with other systems elsewhere in the world network. u1 paUse (as above), with a blank line above and below the displayed contents_signature(s). 3. Enhanced the /1 j option so that it will strip spurious trailing bytes from both JPEG JFIF files and GIF files. 4. Enhanced the Auxiliary Function 3, 4, 5, and 6 &j option so that it will strip spurious trailing bytes from JPEG JFIF files and GIF files, test for truncation, and, in Auxiliary Functions 5 and 6, automatically set aside graphics files which fail the truncation tests. If you are replacing an existing installation, be sure to add the KG,d:\CSA\FGT; ("Failed Graphics Test") target directory to macro [y], so that there will be a place for Auxiliary Function 5 to put such rejects (this is automatically set up by CSAMACS during a fresh installation). You can run GET_DFLT, make this addition in the resulting PUT_DFLT.BAT file, and then run PUT_DFLT. Or, you can do attrib fwkcs.exe -r fwkcs kg,d:\csa\fgt;[y] /dy attrib fwkcs.exe +r Be sure to replace the "d" in "d:\csa\fgt" with the correct letter for the drive holding your \CSA directory. Once you've made the modification, copy FWKCS.EXE to your \CS directory and to wherever else is appropriate for your system (e.g., bulletin boards running Clark Development Company's PCBoard may keep a copy in the \PCB directory, on the PATH). 5. Under Auxiliary Function 5 command &a (processing of files attached to messages), added g option to permit applying to JPEG JFIF and GIF files attached to messages the same settings used for ordinarily uploaded files. 6. Added special purpose stand_alone option /1q, to rapidly identify GIF or JPEG JFIF files which have extraneous trailing bytes, and send their respective d:\path\filename.ext to the redirectable standard output. 7. Fixed a bug in /1m , for displaying the totals when a very large number of duplicate files have been found on a system. 8. Revised Auxiliary Function 1, to support processing of file descriptions which include characters below ASCII 32; with this change, every line processed by /a1 is required to end with a carriage_return line_feed pair (hexadecimal 0d 0a). 9. Corrected a bug in reading the last line of a variable_field single_byte_ terminated sorting_input file. 10. Various other changes. Changes in FWKDG.COM: ~~~~~~~~~~~~~~~~~~~~~ 1. Added ability to do only a specific D:\PATH and all files in directories below there. Format: FWKDG d:\path /option > outfile This supports the use of FWKDG with an installable file system which presents multiple drives as subdirectories, respectively, under a single drive letter (e.g., to use more than 26 CDROM drives). 2. Various other changes. Changes in FWKFF.COM: ~~~~~~~~~~~~~~~~~~~~~ 1. This fast_find function has been rewritten in assembly language in 32_bit native OS/2 protected mode code, joined to the 16_bit assembly language DOS code. This allows the fast find function to perform directly in an OS/2 session, or in a DOS session under any operating system which supports or emulates DOS 3.30 or later, automatically using the correct code for the system in which it is being run. (assembled using Eric Isaacson's A386) 2. When operating in an OS/2 session on a drive formatted with HPFS, FWKFF is able to correctly handle long filenames with gaps in the names. FWKFF is able to search a sorted file for an entry which starts flush left, without requiring an index. On modern equipment, typical search time for an entry in a 1 Gigabyte file would be only a fraction of a second. New program: FWKCSGN.COM: ~~~~~~~~~~~~~~~~~~~~~~~~~ Format: FWKCSGN < FWKUPLD.LOG > FILENAMES /* for help. Purpose: to rapidly extract filenames from an FWKCS(TM) log of uploaded files (can be used also with separate log of files attached to messages). /ver - set exit errorlevel per version number sans ".". Changes in PCBTEST.BAT: ~~~~~~~~~~~~~~~~~~~~~~~ 1. Added optional use of Robert Vostreys's TXT2MSG to report the results of upload testing as a non_public message in conference 0 addressed to the user who uploaded the file, with conditional branching to report the results of remote Lookup. To use this, make TXT2MSG.EXE available on your PATH. ------------------------ Numerous other revisions in programs, user interface, and documentation.