PTSW4Sitemaps
PingTheSemanticWeb for Semantic Sitemaps
PingTheSemanticWeb is a valuable service for the Linked Data initiative.
Unfortunately, it does currently not accept the bulk notification for datasets for which a semantic sitemap is already available.
Below, we provide a free Python script that can be used to notify PingTheSemanticWeb using a given semantic sitemap.
Script
- !/usr/bin/env python
- encoding: utf-8
""" pingTheSemanticWeb.py
Bulk Notification of PingTheSemanticWeb using a Semantic Sitemap
Created by Martin Hepp on 2009-06-14. This software is free software under the LPGL.
Acknowledgements: Some inspiration on using urllib came from Doug Hellmann, http://www.doughellmann.com/PyMOTW/urllib/ """
import urllib from xml.dom import minidom
SITEMAP_URI = 'http://rdf4ecommerce.esolda.com/sitemap.xml' # insert URI of your sitemap here PTSW_URL = 'http://pingthesemanticweb.com/ping.php?url=' SEMSITEMAP_NS = 'http://sw.deri.org/2007/07/sitemapextension/scschema.xsd'
def get_listof_URIs(sitemapURI):
"""Extract a list of all data dump locations from the semantic sitemap at ``"""
sitemap = urllib.urlopen(sitemapURI)
dom = minidom.parse(sitemap)
resources = []
elements = dom.getElementsByTagNameNS(SEMSITEMAP_NS,'dataDumpLocation')
for location in elements:
resources.append(str(location.firstChild.data))
return resources
def call_ptsw(address):
"""Notify PingTheSemanticWeb via http GET of the RDF content at
"""
p = urllib.quote(address)
url = PTSW_URL + p
print "PTSW:", url
response = urllib.urlopen(url)
headers = response.info()
print 'DATE :', headers['date']
print 'HEADERS :'
print headers
- Main
uri_list = get_listof_URIs(SITEMAP_URI) counter = 1 total = len(uri_list) for address in uri_list:
print "URI %d of %d: %s" % (counter, total, address)
call_ptsw(address)
counter = counter + 1
Usage
Simply replace
'http://rdf4ecommerce.esolda.com/sitemap.xml'by the URI of your sitemap.xml file in the following line:
SITEMAP_URI = 'http://rdf4ecommerce.esolda.com/sitemap.xml'