phasmoid wrote:I work with search engine web crawlers. At least until my side job hijacking cigarette trucks gains some steam.
If i understand your question correctly you are using your own crawler to scrape content from other sites, right? Or do you want to get your own site crawled - not sure.
If you can give me a little more info i can possible answer your question.
Sorry for no profile yet. I am a newbie here.
phasmoid wrote:I work with search engine web crawlers. At least until my side job hijacking cigarette trucks gains some steam.
If i understand your question correctly you are using your own crawler to scrape content from other sites, right? Or do you want to get your own site crawled - not sure.
If you can give me a little more info i can possible answer your question.
.
Users browsing this forum: No registered users and 7 guests