A summary of the LivelapBot Internet robot. Including details for the owner, description, HTTP user agent and whether this robot adheres to the robot exclusion standard.
Who owns the LivelapBot robot? Is it a good or a bad robot? And why is it visiting your website?
Shown below is a sample log file entry for the LivelapBot web robot. It’s derived from an Apache web server log file. From the log entry information about how the robot identifies itself, HTTP User Agent, and where it is hosted are given.
Server Log File
vntweb.co.uk 192.99.1.145 - - [24/Mar/2019:10:08:14 +0000] "GET /sql-add-a-default-to-an-existing-table-column/ HTTP/1.1" 200 8018 "https://www.vntweb.co.uk/sql-add-a-default-to-an-existing-table-column/" "LivelapBot/0.2 (http://site.livelap.com/crawler)"
HTTP User Agent
LivelapBot/0.2
IP Addresses
The observed IP address was 192.99.1.145.
WHOIS DNS command gives the following information about the IP address:
| NetRange: | 192.99.0.0 – 192.99.255.255 |
| NetName: | OVH-ARIN-7 |
| OrgName: | OVH Hosting, Inc. |
| Address: | 800-1801 McGill College |
| City: | Montreal |
| PostalCode: | H3A 2N4 |
| StateProv: | QC |
| Country: | CA |
| Updated: | 2017-01-28 |
As can be seen from the above the observed IP address is a part of a block assigned to OVH.
nslookup DNS command gives
145.1.99.192.in-addr.arpa name = ns504328.ip-192-99-1.net.
Owner
Livelap
Country
Netherlands
Exclusion
The user-agent string includes a reference to the website http://site.livelap.com/crawler
The referenced website provides lots of information about the robot, what it collects and how it is used.
There are details about preventing the robot indexing a website by using meta tags.
An example is given of using the robots meta tag to prevent robots from indexing a website
<meta name="robots" content="noindex">
Also given is a specific meta tag of to prevent the Livelap crawler from indexing a website;
<meta name="livelap:index" content="noindex">
Unfortunately, it is confirmed that, at present, the robot does not support the robots exclusion text and obey the crawl delay.
The robots.txt exclusion standard which was described at http://www.robotstxt.org/wc/exclusion.html#robotstxt, but is not currently available. Information is available on the same website https://www.robotstxt.org/robotstxt.html and also on the w3c website at https://www.w3.org/TR/html4/appendix/notes.html#h-B.4.1.1.
Take care making changes to the robots.txt file. A misunderstanding in configuration or an error in configuration can lead to important search engines excluding your website.
Further Info
Livelap allows you to search and explore content being shared in the world.
Livelap uses the social crowd to determine what is most relevant. This trending content is shown in a very visual way, which is easy to understand and explore.
Looking at the blog page the last update was in 2014.
