1. User-agent: Googlebot
2. Disallow: 
3. 
4. User-agent: googlebot-image
5. Disallow: 
6. 
7. User-agent: googlebot-mobile
8. Disallow: 
9. 
10. User-agent: MSNBot
11. Disallow: 
12. 
13. User-agent: Slurp
14. Disallow: 
15. 
16. User-agent: Teoma
17. Disallow: 
18. 
19. User-agent: twiceler
20. Disallow: 
21. 
22. User-agent: Gigabot
23. Disallow: 
24. 
25. User-agent: Scrubby
26. Disallow: 
27. 
28. User-agent: Robozilla
29. Disallow: 
30. 
31. User-agent: Nutch
32. Disallow: 
33. 
34. User-agent: ia_archiver
35. Disallow: 
36. 
37. User-agent: baiduspider
38. Disallow: 
39. 
40. User-agent: naverbot
41. Disallow: 
42. 
43. User-agent: yeti
44. Disallow: 
45. 
46. User-agent: yahoo-mmcrawler
47. Disallow: 
48. 
49. User-agent: psbot
50. Disallow: 
51. 
52. User-agent: asterias
53. Disallow: 
57. 
58. User-agent: libwww
59. Disallow: /
60. 
61. User-agent: *
62. Disallow: /cgi-bin/
63. Disallow: /images/
64. Disallow: /functions/
65. Disallow: /Pager/
66. Disallow: /config.php
67. Disallow: /error.php
68. 
69. Sitemap: http://mobtube.info/sitemap.gz