Epoch 15
AddressBase® products May 2013
Release Note Version 1.0
GB Coverage 29/05/2013
Introduction
This release note provides information about the May 2013 release of the AddressBase products. This includes the details of any issues that exist in this release. Some of these issues will be resolved in the next release of the AddressBase products. However, some require additional work to resolve fully so we will therefore prioritise these and update on progress in future AddressBase products release notes.
1 Product counts
The following are approximate product counts (rounded down) for this release of the AddressBase products:
Product / CountAddressBase / 27,491,000
AddressBase Plus / 34,067,000
AddressBase Premium / 35,706,000
2 Source data currency
The following information relates to the currency of the source data used in the creation of Epoch 15:
Data Source / DateRoyal Mail PAF / April 2013
National Land and Property Gazetteer / 01 May 2013
3 AddressBase Issues CSV and GML
No non-conformities identified.
4 AddressBase Plus Issues CSV and GML
Non-conformities identified:
· 2 records with a SAO start suffix that is not character type.
· 2 records missing a street name and administrative area.
To help identify the specific records affected there is an accompanying release note Epoch 15 text file available from the AddressBase Plus product page
AB_PLUS_E15_Release_Note_txt tables
5 AddressBase Premium Issues CSV and GML
Non-conformities identified:
· 2 records with a SAO start suffix that is not character type
· 1 missing street USRN (affecting 2 LPIs) in the non-geographic chunk GB set
· 7 missing street USRNs (affecting 66 LPI.UPRNs) in the geographic chunk GB set
To identify the specific records affected there is an accompanying release note Epoch 15 txt file available from the AddressBase Premium product page:-
AB_PREMIUM_E15_Release_Note_txt tables
6 AddressBase Premium CSV: issue relating to loading Area of Interest (AOI) non geographic data.
An issue exists in the non-geographic supply of AddressBase Premium CSV. This issue affects the usability of the Header and Trailer records when loading AOI data into some software.
Note: This issue does not affect the managed GB set of AddressBase Premium CSV.
The issue found causes the “VOLUME_NUMBER” in the Header record and the “NEXT_ VOLUME_NUMBER” in the Trailer record to lose its sequence between records 1 and 4.
Please see the table below for an example (Correct numbers are shown in Red):
.csv File / Volume Number / Next Volume NumberAddressBasePremium_FULL_2013-03-04_001.csv / 1 / 0 - It should be 2
AddressBasePremium_FULL_2013-03-04_002.csv / 4 - It should be 2 / 5 - It should be 3
AddressBasePremium_FULL_2013-03-04_003.csv / 5 - It should be 3 / 6 - It should be 4
AddressBasePremium_FULL_2013-03-04_004.csv / 6 - It should be 4 / 7 - It should be 5
AddressBasePremium_FULL_2013-03-04_005.csv / 7 - It should be 5 / 8 - It should be 6
AddressBasePremium_FULL_2013-03-04_006.csv / 8 - It should be 6 / 9- It should be 7
AddressBasePremium_FULL_2013-03-04_007.csv / 9 - It should be 7 / 10- It should be 8
AddressBasePremium_FULL_2013-03-04_008.csv / 10 - It should be 8 / 11 - It should be 9
AddressBasePremium_FULL_2013-03-04_009.csv / 11 - It should be 9 / 12 - It should be 10
AddressBasePremium_FULL_2013-03-04_010.csv / 12 - It should be 10 / 0
A patch has been developed to run on your raw data holdings to fix this. This can be found at the foot of this release note.
See following tables for relevant reference information regarding “VOLUME_NUMBER” and “NEXT_ VOLUME_NUMBER”; extracted from product technical specification:
Record example
10,"GeoPlace",9999,2011-07-08,1,2011-07-08,16:00:30,”1.0”,"F"
Record example
99,0,1269403,2011-07-08,16:00:30
Interim fix for issue relating to loading Area of Interest (AOI) non geographic data.
This section details the method for patching your data when your data needs to be loaded using the header and trailer records.
CREATE folders for the patch
· Create a new folder on a mapped drive e.g. C:\Temp\VOLUME_LOADER_PATCH
NOTE: Ensure there are no spaces in this path.
· Next create 2 folders in C:\Temp\VOLUME_LOADER_PATCH:
data
utilities
MOVE .csv data
Put the .csv files that require patching into the ‘data’ folder that you’ve just created
CREATE/SAVE patch utilities
· The next step requires you to open the utilities folder that you have just created and add 3 utilities
UTILITY 1: Copy the following script into a .txt file named: fix_AddressBasePremium_headerFooter.txt
# COMMAND LINE gawk -v headerFile=0 -v trailerFile=0 -f fix_AddressBasePremium_headerFooter.awk infile.csv > outfile.csv
BEGIN {FS = ","}
{
if ($1 == "10") {
printf("%s,%s,%s,%s,%s,%s,%s,%s,%s\n",$1,$2,$3,$4,headerFile,$6,$7,$8,$9)
} else if ($1 == "99") {
printf("%s,%s,%s,%s,%s\n",$1,trailerFile,$3,$4,$5)
} else {
print $0
}
}
Save fix_AddressBasePremium_headerFooter.txt as a .awk file.
UTILITY 2: Copy the following script into a .txt file named: fix_AddressBasePremium_headerFooter.txt
SET DATADIR= C:\Temp\Volume_loader_patch\data
SET NUMFILE=6
dir %DATADIR%\*.csv /b/s | gawk -v aLastRec=%NUMFILE% "{i=split($0,filepath,\"\\\\\"); if (NR == aLastRec) print $0 \",\" filepath[i] \",\" NR \",0\"; else print $0 \",\" filepath[i] \",\" NR \",\" NR+1}" > fix_AddressBasePremium_headerFooter.tmp
FOR /F "tokens=1,2,3,4 delims=," %%A IN (fix_AddressBasePremium_headerFooter.tmp) DO (gawk -v headerFile=%%C -v trailerFile=%%D -f fix_AddressBasePremium_headerFooter.awk %%A > %%B)
del fix_AddressBasePremium_headerFooter.tmp
pause
exit
· Set the location of the data e.g. SET DATADIR=C:\Temp\Volume_loader_patch\data
· ENSURE THAT THE DATA AND THE PATCH UTILITIES ARE NOT IN THE SAME FOLDER.
· Set the location of the data and the number of files that need patching.
e.g. SET NUMFILE=6
This will mean that the last volume in the customers AOI will have a ‘0’ put in the trailer.
Save fix_AddressBasePremium_headerFooter.txt as a .bat file.
UTILITY 3: Download gawk from here:
http://omniplex.om.funpic.de/home/ltru/gawk-win.zip
· Save the gawk.exe in the utilities folder
RUN ‘fix_AddressBasePremium_headerFooter.bat’ FILE
Double click on the fix_AddressBasePremium_headerFooter.bat file. This will create copies of the data in the same folder that the fix_AddressBasePremium_headerFooter.bat file is located in.
These files will be fixed and will now load into your software
<end>
Epoch 15 release notes Page 1 13/06/201305/06/2013