[db-wg] Weirdness in DB files
- Previous message (by thread): [db-wg] Weirdness in DB files
- Next message (by thread): [db-wg] New on RIPE Labs: Impact of NWI-10 on Country Codes in Delegated Statistics
Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
Edward Shryane
eshryane at ripe.net
Thu Dec 17 15:56:43 CET 2020
Hi Cynthia, You can also use an empty line as a delimiter, and ignore any lines starting with '#' or '%' if you're only interested in the objects themselves. There is an example parser in the Whois codebase: https://github.com/RIPE-NCC/whois/blob/6073451f5b250d97edc0bde5f540d949a23cd491/whois-rpsl/src/main/java/net/ripe/db/whois/common/io/RpslObjectFileReader.java Regards Ed Shryane RIPE NCC > On 17 Dec 2020, at 15:45, Cynthia Revström via db-wg <db-wg at ripe.net> wrote: > > for my use case it's mainly a convenient object delimiter. > > On Thu, Dec 17, 2020, 14:15 Mahesh Aggarwal <maggarwal at ripe.net <mailto:maggarwal at ripe.net>> wrote: > Hi Cynthia, > > Thanks for you email. > > We have investigated, of 1.7M lines in the aut-num split file, the last tag appears after 1.3M lines. This is because not all aut-num objects contain tags. > I confirm that split files are well formed and no tags are missing. > > There are currently 22997 out of 36481 autumn objects in split file for which tag information is available. > Also tagging information is available for roughly 63% of ‘ASSIGNED' autumn objects. > > We released the tag beta feature in 2013 but stopped automatically updating the tags some time later. > So all the tags that are present in split files are automatically generated during that time period and objects created/updated after that have the tags information missing in split files. > > We need to ask the community whether we resume the tagging of objects or remove the functionality all together. > > Is tagging information is useful for you? We can put forward a case to the community for resuming this functionality. > > Regards, > Mahesh > RIPE NCC > >> On 17 Dec 2020, at 09:27, Edward Shryane via db-wg <db-wg at ripe.net <mailto:db-wg at ripe.net>> wrote: >> >> Hi Cynthia, >> >> The DB team will investigate further and let you know. >> >> Regards >> Ed Shryane >> RIPE NCC >> >> >>> On 17 Dec 2020, at 03:49, Cynthia Revström via db-wg <db-wg at ripe.net <mailto:db-wg at ripe.net>> wrote: >>> >>> Hi DB-WG, >>> >>> I just noticed that the (at the time of writing, serial 49363913) latest aut-num split db file (possibly elsewhere too) sort of just seems to break at some point. >>> >>> The lines like below simply stop appearing: >>> >>> % Tags relating to 'AS3333' >>> % RIPE-REGISTRY-RESOURCE >>> >>> Here's a section where you can see it happening: https://gist.githubusercontent.com/bitcynth/d81688c6b7587e0179d55b8324535ff4/raw/57fcf2829967c0a9c1039180b2fd3e2a2cbb7e09/ripedb.txt <https://gist.githubusercontent.com/bitcynth/d81688c6b7587e0179d55b8324535ff4/raw/57fcf2829967c0a9c1039180b2fd3e2a2cbb7e09/ripedb.txt> >>> >>> Any clue why this is occurring? or is it just a bug? >>> >>> - Cynthia >> > -------------- next part -------------- An HTML attachment was scrubbed... URL: <https://lists.ripe.net/ripe/mail/archives/db-wg/attachments/20201217/ae8e3de7/attachment.html>
- Previous message (by thread): [db-wg] Weirdness in DB files
- Next message (by thread): [db-wg] New on RIPE Labs: Impact of NWI-10 on Country Codes in Delegated Statistics
Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
[ db-wg Archives ]