CONTACTS 
0201 - JPS Net                            800 711 5353 fax or 800...
020101 - Mr. Brien NLN; Customer Support Rep
020102 - Technical Service       =415 376 0121
0202 - JPS Net                            800 711 5353 fax or 800...
020201 - Mr. Joe NLN; Customer Support Rep; Technical Service       =415 376 0121

SUBJECTS
Web Site, SDS Data Base, Diary 02 Setup

0403 -    ..
0404 - Summary/Objective
0405 -
040501 - Follow up ref SDS 10 1380, ref SDS 9 5029.
040502 -
040503 - Completed first phase of getting SDS records in HTML format on the
040504 - Communication Metrics Web site.  Seems to take about 3 hours to
040505 - transfer 12 MB.
040506 -
040507 -    [On 980316 test failures of Web site accessing SDS. ref SDS 12
040508 -    1437]
040509 -
040510 -    [On 980321 successful test of Web site for busiess intelligence.
040511 -    ref SDS 15 4345]
040512 -
040513 - JPS does not support zipping files for efficient transfer. ref SDS 0
040514 - 4674. Did not get Telnet instructions.  Need a way of efficiently
040515 - updating the records each day to support timely "intelligence." ref
040516 - SDS 0 2425
040517 -
040518 -
040519 -
0406 -
0407 -
0408 - Progress
0409 -
040901 -  ..
040902 - Assemble SDS Records to Upload on Marketing
040903 -
040904 - Now that we have completed changes to the record selection and SDS
040905 - HTML conversion tools, ref SDS 11 3435, I began uploading records to
040906 - the Web site.
040907 -
040908 - I am uploading records on Communication Metrics definition so they can
040909 - be used to test, improve and to illustrate how the Internet can be
040910 - used to deliver...
040911 -
040912 -                  Anytime, Anywhere Intelligence
040913 -
040914 -     ...per goal on 971021. ref SDS 1 3636
040915 -
040916 - We are uploading only the 02 Diary records.  These transferred records
040917 - omit the Reference field, per ref SDS 11 4969.  Links in the Contacts
040918 - have also been removed.
040919 -
040920 - Assemblying records for uploading seems to work pretty well now using
040921 - 06116, per planning on 971206.
040922 -
040923 - The processor can be somewhat selective, keeping in mind it assembles
040924 - an entire record for each subject, and so necessarily includes
040925 - portions of other subjects.  This allows, however, people to access
040926 - other records on the same subject, and to review information on
040927 - related subjects, which is a goal of
040928 -
040929 -                     "business intelligence."
040930 -
040931 -
040932 - I deleted the listing of the initial submissin on Friday.
040933 - ..
040934 - Ran Web site data base assembly op for following subjects:
040935 -
040936 -      SDS Development, Marketing
040937 -
040938 -      03 00050 01 02       94 to 98   Customer perceived value
040939 -      03 00050 01 05 10    94 to 98   Sales Resistance/Objections
040940 -      03 00050 01 05 1C    94 to 98   Sales Points, A - D
040941 -      03 00050 01 05 1D    94 to 98                 E - L
040942 -      03 00050 01 05 1E    94 to 98                 M - Z
040943 -      03 00050 01 08       94 to 98   Application to market
040944 -
040945 - This is 8 MB to transmit, and on the disk it is 11 MB
040946 -
040947 -         730 files in 630 folders
040948 -
040949 - I copied this initial data base to c: sd 08, deleted the stuff on h:
040950 - and then put the next bunch of stuff on h: so I can send it to the
040951 - server in a second group.
040952 -
040953 - As an experiment, to illustrate a consolidated body of stuff, will put
040954 - the records for the Communication Metrics Web site project on the
040955 - site, which includes the JPS procurement and configuration.
040956 -
040957 -      04 00067         Did this
040958 -
040959 - Decided to put the PG&E generic stuff on the site, since I am meeting
040960 - with Bill tomorrow.
040961 -
040962 -      04 00061         Did this
040963 -
040964 - Bill DeHart's personal support account
040965 -
040966 -      04 00066         Did this
040967 -
040968 - Corps of Engineers
040969 -
040970 -      04 00065         Did not do this for now.
040971 -
040972 -      Want to see how well the initial effort works.  The marketing
040973 -      records will include a lot of this CEO stuff anyway.
040974 -
040975 -
040976 -
040977 -
0410 -

SUBJECTS
Updating Server Using Directories on Local
Store SDS Records in Multiple Drives
Avoid Uploading Files That Have Not Changed

0706 -
070601 -  ..
070602 - Need Procedures to Update Server Efficiently
070603 -
070604 - We need to think through the process of updating the data base
070605 - once it has been created, so we do not waste a lot of time copy files
070606 - that have not changed.
070607 -
070608 -     [On 980317 developed initial methods. ref SDS 13 3479]
070609 -
070610 - Need procedure for zipping files.
070611 -
070612 -     [On 980317 got lead on this. ref SDS 14 5108]
070613 -
070614 - Need to avoid updating existing files that have not changed.
070615 -
070616 - Looks like we have to keep a composite inventory of files uploaded in
070617 - order for the update routine in 06116 to run, since it compares files
070618 - using "dir."
070619 -
070620 - We might be able to do the compare in directory and save the files in
070621 - another directory, so that we can upload them without having duplicate
070622 - what has already been transferred.  After the upload, then the
070623 - transfer directory has to copied to the permant inventory used as the
070624 - comparison data base for the next update.
070625 -
070626 - This reminds of the story Lucille used to tell about the taking the
070627 - cat, the chicken and the fox across the stream without having any two
070628 - of them along at one time.
070629 -
070630 -     [On 980317 developed initial methods. ref SDS 13 3479]
070631 -
070632 -
070633 -
070634 -
0707 -
0708 -

SUBJECTS
Web Site, SDS Data Base, Diary 02 Setup
Upload Records
Test Delivery, Access SDS HTML Files
Ws_ftp logs in each directory

1207 - 0150 [next morning] Begin transmitting
1208 -   ..
120801 - Began uploading initially the files on c: sd 10, which were
120802 - created in h: sd 08, and copied to c: sd 10, so I could do the upload
120803 - in groups.
120804 -
120805 - I used ws_ftp.  Began the upload after midnight, since JPS said this
120806 - evening that it is the best time to do a large upload. ref SDS 0 1513
120807 -
120808 -     W95 Properties reports it has...
120809 -
120810 -                 8 MB which is 16 MB used on our disk
120811 -             1,298 files
120812 -               625 folders
120813 -
120814 -     ...actually these calculations are incorrect, because the ws_ftp
120815 -     program creates a transfer log file in every directory. ref SDS 0
120816 -     3711
120817 -
120818 - I observed the initial up load which took about 40 minutes to upload
120819 - files for 1994 to 1995
120820 -
120821 - I went to bed.  If it took 40 minutes for 30%, it likely took 135 for
120822 - all of it, allowing for more records in 1996 and 1997 because that
120823 - period was more heavily concentrated in marketing activity, which is
120824 - the subject being uploaded.
120825 -
120826 - So... 135 minutes for 8 MB = .05 MB per minute
120827 -
120828 -
1209 -
1210 -
1211 - 0510 [next morning] uploaded files on h:
1212 -
121201 - Transferred the second bunch of files on h:
121202 -
121203 -     W95 Properties reports it has...
121204 -
121205 -                 4 MB which is 11 MB used on our disk
121206 -             1,048 files
121207 -               433 folders
121208 -
121209 - If we transmitted at the same rate of .05 MB per minute, then this
121210 - transfer took about 80 minutes.
121211 -
121212 - So 12 MB required about 215 minutes = 3.6 hours, say 4 hours.
121213 -
121214 - On our disk this is 27 MB in 4 hours.
121215 -
121216 -
121217 -
121218 -
1213 -
1214 -

SUBJECTS
Web Site, SDS Data Base, Diary 02 Setup
Upload Records
Test Delivery, Access SDS HTML Files
Ws_ftp logs in each directory
FTP Creates Log in Local Directories

1608 -
160801 -  ..
160802 - Ws_ftp Creates Logs in Each Directory Messes Up Updating Server
160803 -
160804 - We need a way to upload stuff to the Server, then each day assemble
160805 - records that are new or have changed and transfer them to the server.
160806 -
160807 - The Ws_ftp program puts a log in the directory of the local drive for
160808 - every file transferred to the server.
160809 -
160810 - This practice seems like it will cause these log files to be
160811 - transferred to the server when updates are made, because transfers
160812 - are specified at the group directory level.
160813 -
160814 - How can we eliminate the ws_ftp logs from being created, or can they
160815 - be created in a single file for the transfer and put in a designated
160816 - directory?
160817 -
160818 - Maybe the ws_ftp pro program can help.
160819 -
160820 -    The ws_ftp.log files are helpful in showing data was transferred,
160821 -    but we only need one for each transfer.
160822 -
160823 -
160824 -
160825 -
160826 -
160827 -
1609 -
1610 -

SUBJECTS
Telnet, W95 Utiity
Deleting Files and Subdirectories
Setup
Zip, JPS will not unzip
Uploading, Downloading Files
Acquisition
Managing/Manipulating Data on Server

2410 - Discussion
2411 -   ..
241101 - Talked to Josh
241102 -
241103 -
241104 - Managing Files on Server with Unix, Telnet
241105 -
241106 - Follow up ref SDS 10 1690.
241107 -
241108 - Josh said Joe is off today.  He is scheduled to be on the job
241109 - tomorrow from 1700 to 0200 the next morning.
241110 -
241111 - Josh could not find a problem number or other identification by which
241112 - Joe may have associated his work on this matter.  He asked his
241113 - colleagues about it and no one else is familiar with Joe's efforts or
241114 - progress on this.
241115 -
241116 - Josh said he is not familiar with using Telnet with a table or other
241117 - procedure that enables the customer to manage information on the JPS
241118 - server efficiently.
241119 -
241120 -
241121 -  ..
241122 - Uploading Using Zip
241123 -
241124 - Can we upload a lot of stuff using zip?
241125 -
241126 - Josh said we can zip files and upload them, but the owner of JPS,
241127 - Brad, won't let anyone from JPS unzip them.  Josh indicated that Brad
241128 - does not want customers to unzip files to their service space either.
241129 - Brad's idea is for the customer and JPS to tie up the phone lines for
241130 - a longer period.
241131 -
241132 -
241133 -  ..
241134 - Uploading Seems to Replace Every File Whether or Not New/Changed
241135 -
241136 - If we begin uploading can we tell the thing to only replace a changed
241137 - file?
241138 -
241139 - Josh said the Ws_pft program warns the customer about an uploaded file
241140 - being older.  The customer can then indicate whether to procede. Josh
241141 - said there is not a switch to enable the ws_ftp program or any other
241142 - program for uploading information to a server, that enables the
241143 - process to skip older files.
241144 - ..
241145 - I noticed on the ws_ftp Web site that they have a more robust
241146 - program that costs $35 or so.  Maybe it can help on some of this
241147 - stuff.
241148 -
241149 -     [On 980421 purchased this program. ref SDS 16 0412]
241150 -
241151 -
241152 -  ..
241153 - Midnight to 0500 Best Time for Large Data Transfers
241154 -
241155 - I advised we have a fairly large transfer to make, between 10 and 15
241156 - MB, and asked if there are routinely times that are more conducive to
241157 - large transfers like this?
241158 -
241159 - Josh said the best time for the JPS servers is after Midnight until
241160 - about 0500.
241161 -
241162 -
241163 -
241164 -
241165 -