Category: Tech

When I first started hosting my own webpages, I noticed many requests for a file called robots.txt on my machine from the log files kept by IIS. Here’s an example but it was generated on a Linux OS, Apache web server.

255.255.255.255 – – [02/May/2004:05:34:56 -0700] “GET /robots.txt HTTP/1.0” 404 – “-” “Googlebot/2.1 (+http://www.googlebot.com/bot.html)”

So I paid a visit to the link and learned how google and other search engines get their results from. Automated programs to scour the net for webpages. The link also teaches you how to setup the robots.txt so as to control how googlebot indexes your webpage.

Because I’m running off a low speed connection and was using one machine to do all my tasks, I can’t afford too much traffic coming in especially when I’m gaming. So I setup a robots.txt file to tell all bots/spiders/crawlers not to index anything from any of my websites.

Reasons being they suck up my bandwidth and they brought visitors who are searching for content I do not have. All those unneccessary traffic eats up my precious CPU cycles.

One of my websites, the IRC Quotes site, contains a name of a Japanese song with the .mp3 extension. Google indexed this and I had about 20-30 visits, over a long period of time, from people who came from Google and their search string was the same songname with the file extension. I wasted their time and they wasted my CPU cycles.

Lastly, here’s a link to the site that inspired me to write this entry. It also contains interesting information on Bandwidth and Data Transfer on webhosting providers and why you might want to create a robots.txt file to manage the crawlers. stargeek – Bandwidth and Data Transfer – Which is which?

I had to use a lot of strength and will to hold down my laughter when I read this at work.

[Turtle] hmm
[Turtle] ctfmon.exe
[Turtle] no jamacians capturing any flags on my computer that i know of

Source: Bash.org

Well, version 2.5 now. I decided to have 2 columns, 1 for entries regarding my Life (Life Blog), and the other, entries regarding Computers, Web Developing, Games (Tech Blog). I still need more work for the background image. Positive or negative comments are welcome~

I wonder if the scroll bars of my 2 blog columns can be made transparent to show the background behind. If anyone knows, please teach me! [:D]

I used a screenshot from the game Lineage2, that character is my level 28 Female Human Knight wielding 2 swords lent to me by a friend.

My boss is having me work on a new design for his church. I’m going to learn to use CSS instead of HTML tables for the site layout. Seems like there’s a lot of advantages using CSS to design the layout. What I note is simpler codes and faster load times. The current sites that I’m working on and using HTML tables are harder to maintain and change because of the code structure of a table. Experienced web designers/developers should know how troublesome it is and how worse it can get when it comes to a point where we have to nest tables (having more tables in a table). I have a feeling it’s going to help me in the long run especially when my work involves me having to code and design a dynamic, database-driven website all by myself.

I think I’m going to start a second blog. Either incorporate it into this blog as a sub section or a totally new blog. It’s for me to dump any computer related stuff. Sort of like a tech blog.

The open beta for Lineage2, Japan, is going to end soon in June. I’m becoming so attached to the game I might sign up once it goes official. There may be a problem for foreigners signing up but I’m checking it out with some Americans who are also interested in playing in Japan servers instead of their North American ones.

The biggest reason for staying on Japan’s instead of going over to NorthAmerica’s is the difference in culture. If you want lots of action, drama, betrayal, war, NA is the place to go. The Japanese are friendlier and playing on Japan’s would be more relaxing. [:)]

Darn, the other day my mum was switching the light bulbs with the electricity still turned on. She caused a short circuit which shut down my 2 computers. When I got home, I could not boot up cos 1 of the harddisks on my webserver could not be detected. Right now, I’m still too busy to fix things. I only just realized my blog site is cocked up.

Around 5 years ago… I spent $2500 on…
Pentium2 233MHz MMX
64MB SDRam PC100
4MB AGP!
3.2GB 5400RPM Harddisk!
Creative AWE64 that uses the ISA slot!
WinNT 4.0 Workstation. I shouldn’t have bought this but it was reccomended by a friend. Ended up using Windows 95 because of driver conflicts.
17″ Philips monitor (Served me well)