VK4PK Maintaining the LyonsComputer Web Site

  1. Setting up the Platform
  2. Using "checksum" State to control uploads
  3. Editing the "sitecopy" configuration file
  4. The "bldidx.sh" script
  5. Recovering from "sitecopy" Database Corruptions
  6. Online Link Checkers


Setting up the platform

For convenience, add an environment variable, "AR" to .bashrc file in the home directory
"export AR=/nfs/mnt/extra/glenn-docs/develop/Amateur-Radio"

The bldidx.sh script requires linkchecker and sitecopy applications.

Run the bldidx.sh script to make a temporary copy of the html file tree to the ~/www-build folder. Only required html files and their dependant files (images, pdf's, etc) will be copied.


Using "checksum" State to control uploads

Important Note: Because the bldidx script copies all web page files to a temporary build directory if the "timesize" method is used, sitecopy will copy every file to the live website every time. Therefore, the "checksum" method is required if only modified files are to be uploaded.


Editing the sitecopy configuration file

File state is stored in the storage files (~/.sitecopy/*), and is used to discover when a file has been changed. Two methods are supported, and can be selected using the state option, with either parameter: timesize (the default), and checksum.

timesize uses the last-modification date and the size of files to detect when they have changed.
checksum uses an MD5 checksum to detect any changes to the file contents.

Note that MD5 checksumming involves reading in the entire file, and is slower than simply using the last-modification date and size. It may be useful for instance if a versioning system is in use which updates the last-modification date on a 'checkout', but this doesn't actually change the file contents.
Source: "man sitecopy"

*** NOTE the .sitecopy has to be implemented on one workstation for the site state
to be current. ***

Setup sitecopy's configuration file, ~./sitecopyrc

Man page: https://linux.die.net/man/1/sitecopy


The "bldidx.sh" Script


Recovering from "sitecopy" Database Corruptions

If the the uploaded site becomes out of sync with the local database run the commands:

This can occur when an sitecopy update is interrupted or fails to complete. The fetch option can take some time as it has to recalculate the checksum for every file and folder on the server. The update may have to be run a few times to complete the process.


W3C - Check links and anchors in Web pages or full Web sites:

LinkChecker - Check websites for broken links:


Linkchecker Commands

Glenn Lyons VK4PK
Ver:gnl20181201 - pre published v0.9