Nikita the Spider * Future Features

Navigation

Future Features

I've considered a number of features that I might add to Nikita, but I need your help to decide which ones most deserve attention. Vote for the ones you like in the list below. If you the list doesn't contain a feature you want to see, please suggest it.

Subscription. A subscription would mean that Nikita would spider your site as frequently as you like (perhaps anywhere between daily and monthly) and you'd only pay for pages that have changed since Nikita's last visit. Your latest reports would always be available online.
Dublin Core. Nikita's page reports could let you know if your pages meet the Dublin Core Metadata standards.
Section 508. Nikita's page reports could let you know if your pages meet the U.S. Government's Section 508 accessibility requirements.
WCAG. Nikita's page reports could let you know if your pages meet the Web Content Accessibility Guidelines.
Cookies. Nikita eats cookies but doesn't do anything else with them. We could teach her to send cookies back to the server like a good user agent should.
Invalid URL characters. RFC 2396 states which characters are valid in URLs. Nikita could issue a warning in a report if she finds a URL on your site that contains character(s) that violate RFC 2396.
PDF Reports. Nikita's reports currently come as XML and HTML. She could also create PDF reports suitable for presentation to your boss. These would be less detailed than the XML and HTML files and would offer a more graphical view of the site.
Report Broken URL Fragments. Nikita ignores fragments when checking links for validity. For instance, the link http://example.com/foo.html#banana is considered valid as long as foo.html exists regardless of whether or not it contains the anchor banana. Nikita could check to see that anchors exist for each fragment-containing URL that it checks. This feature would only work for local links.
Reverse Links Report. On each page's report, Nikita could include a list of the pages that link to that page. Naturally, this would only include links from other pages on your site that Nikita has spidered.
Report Page Language. Nikita could report the language(s) specified by a page in the HTTP response headers, META tags and on the HTML element.
More Specific Decode Errors. When Nikita can't decode a page because the specified encoding is wrong; Nikita simply informs you of the failure and doesn't specify the offending character. Nikita could be more specific about which character(s) caused the problem.
Automatic Recovery From Decode Errors. When Nikita can't decode a page because the specified encoding is wrong; Nikita simply informs you of the failure and moves on to the next page. She could instead try various other encodings to see if any of them can decode the page successfully.
META/header Mismatches. Nikita tells you if you have an encoding specified in both the HTTP header and an HTML META http-equiv tag. She could also let you know if any other META http-equiv tags clash with the headers that your server sends.
HTTPS Support. Nikita doesn't do secure HTTP, but she could.
Localization. Nikita's reports could come in other languages. Let me know what language you'd like to see Nikita speak.

Other