G - DIGITAL MARKETING AGENCY

welcome to our blog

We are Digital Agency

Gyan Infotech is a Noida-based Digital Agency delivering high quality, cost effective, reliable result-oriented web and e-commerce solutions on time for a global clientele.
Always find time to play, experiment and explore. It will change the way you think, work and live.

We are a passionate, results-oriented digital marketing team based in India . We deliver end-to-end website design, development and digital marketing solutions that are focused on client goals and objectives.

Posts

Comments

The Team

Company CEO

Connect With Us

Join To Connect With Us

facebook
twitter
google +
youtube
linked In

Portfolio

1st Year Anniversary / Birthday Google's Penguin Update All About The New Google “Hummingbird” Algorithm Google Panda 4.0 Now Rolling Out; A New Panda Algorithm Google Penguin 3.0: Worldwide Rollout Still In Process Google Releases First Penguin Update In Over A Year - 20 OCT 2014 Google Releases Penguin 3.0 — First Penguin Update In Over A Year
You are here : Home »

    Posted by: Vikas Kumar Raghav Posted date: 9:37 PM / comment : 0


    Google: Keep Your Robots.txt Simple

    A Google Webmaster Help thread has Google's John Mueller responding to some complex robots.txt questions.


    In that, he strongly recommends that when you do set up a robots.txt file, make sure you keep it very simple. John said:

    When possible, I'd really recommend keeping the robots.txt file as simple as possible, so that you don't have trouble with maintenance and that it's really only disallowing resources that are problematic when crawled (or when its content is indexed).

    Heck, John even has recommended you remove the robots.txt file completely if it is not needed but always make sure to keep it under 500KB if you do have to go more complex.

    To see the context this is in, see the Google Webmaster Help thread.

    Personally, I am all for not using robots.txt files when possible.

     Design by Vikas Kumar Raghav | Seo Company India - Seo Agency India -Seo Blogs- Seo Training Institute

    icon allbkg

    Tagged with:

    About Vikas Kumar Raghav

    An expert in SEM (SEO + SMO + PPC) and Market Research filed with having more than 5+ years experience. Extensive experience in the development of SEO, SEO Researchers. Knowledgeable in all aspects of Search Engine Optimization techniques, methods, algorithms for all major SEO like Google, Yahoo and MSN.
    Next
    Newer Post
    Previous
    Older Post

    No comments:

    Leave a Reply

Subscribe to: Post Comments (Atom)

Comments

The Visitors says

Copyright © 2014 G - DIGITAL MARKETING AGENCY | Customized by Vikas Kumar Raghav