Copyright ©1997-2011 Glenn Fleishman except as noted otherwise. All rights reserved. For permission to reprint, contact Glenn Fleishman at glenn at glennf.com. Photo © 2008 Laurence Chen; used with permission.
Turning technology from mumbo-jumbo into rich tasty gumbo
I’ve been encouraged by Ben’s fans to write more about him. Last night, we moved him into the nursery after having spent his whole life—his whole life!—sleeping near us in a co-sleeper, which is a sort of bed sidecar. He now sleeps from 5 to 9 hours from when we put him down to when he nurses in the middle of the night, and then usually sleeps from then to 6.30 am when he wants to wake up or nurse again. We’re working on that, as we’re told by others and have read that if a baby can occasionally sleep 9 hours (he’s only done that twice) that he could probably start sleeping consistently all through the night. He’s just nearing 15 weeks, so we now have to work on turning that ship a bit.
He’s gotten quite a bit more difficult to put down for a nap. He’s learned some resistance, but his sleepiness still comes through. Sometimes, I can jiggle the cradle slightly and he passes out. Other times, he will fall asleep in our arms when rocking or bouncing him, and then wakes up the instant his head hits the pillow. He’s a little Gandhi about sleep.
I’m reading Babywise now at the suggestion of a colleague, and I’m finding it pretty good, but, unfortunately, we’re already following most of the approach that the book suggests. It’s a bummer to not have additional tips! But I guess we’re already wise about babies? This one, anyway. He’s baffling us a bit the last two days, but we think it’s cabbage salad related—he didn’t eat it, but mom did, and it’s her first serious brassica intake in many months.
I’m about to get out of the friendly business of running my own email and DNS servers, while retaining my own Web servers. This marks the end of 10 years of running my own stuff, starting back in 1994 when I co-founded Point of Presence Company (POPCO). I sold the company, but my friend Scotty let me continue to run email and DNS and other stuff from his servers. I eventually set up my own servers when I moved to an office with other freelancers in 1999.
Over the years, I’ve wrestled with the pain of servers dying: hard drive failure, hacker attack, power supply failure, DSL modem crashes, misconfigurations, and many others.
In the same period, I’ve finally found outside companies that I trust: digital forest hosts my three computers (soon to be two: anyone in the market for a Xserve dual G4 1.33 GHz server?); easyDNS handles my registrar and DNS services for most of my domains; and Fastmail.fm has been my on-the-road mail service for checking accounts securely.
I’ve helped all of my various friends and colleagues migrate their domains, email accounts, Web sites, and blogs to other services—only a couple of sites remain, and my wife and dad’s email accounts. And my own. I’ll be shortly handling a final migration—gulp!—so that my email will be totally received by Fastmail.fm (which has POP, IMAP, and SMTP over SSL, an awesome option for security), and my DNS will be entirely hosted by easyDNS.
It’s scary. I trust these companies for a few reasons. One, I’ve had accounts with them now for some time with no problems. Two, when they’ve had unexpected performance issues—such as a denial of service attack on easyDNS—they’ve been honest and communicated immediately, while detailing steps they have taken to prevent recurrence.
I’ve also spoken or emailed with the co-founders of both companies. easyDNS’s founder read some feedback email I sent about an ongoing typo in a DNS file that I couldn’t seem to get support to fix on a Friday late afternoon, and he had it fixed immediately. I interviewed Fastmail.fm’s co-founder, too, for an two-part series in the Seattle Times (running last Monday and this Monday), and I was even more impressed with the service after getting more details about their policies and operations from the horse’s mouth.
I’ll still be running my own Web servers because I rely too much on their performance and abilities to outsource that for the moment. (If I could buy access to a high-performance MySQL server at the right price, I might do that, too.)
Scary stuff, putting yourself in the hands of others.
Later: I did the deed, pointing my MX records to fastmail.fm. A few configuration errors later on my remaining mail server and its accounts, and I’m off. Next, transfering the rest of my DNS to easyDNS…
I read this piece on a proposed 10 percent (37 cent to 41 cent) first-class postage increase in the Wall Street Journal that had a quite editorial statement in the second paragraph:
Such a rise would push the price of a first-class stamp to at least 41 cents — and hurt consumers and businesses that already have shouldered three rounds of rate increases in the past few years.
The article also notes that First-class stamps have jumped 12% since early 2001. The rate won’t take effect until 2006 if they get through the various hoops. The USPS says it’s for inflation plus a pension contribution issue.
But I went and found historical postage prices and graphed them against inflation. In fact, in 2003 dollars, a 41-cent stamp will cost less than any time since 1974. Real dollar postage increase took place during the Depression amid inflation, when an increase in postage in 1932 doubled its actual cost. But that rate stayed in place until 1958, when an increase was still far below the 1932 dollar value of the previous postage rate. From 1958 to 1978, rates increased, fed partly by a privatization in the early 1970s. But rates have dropped and stayed in a narrow band since then.
The chart below shows postage value in the denominated dollars at the bottom. The Postal rate (blue) is that value in the bar chart. Red is the value adjusted for inflation at the end of the period during which the blue rate was charged. (Note this increases only from 1919 to 1932 because of deflation.) The yellow bar shows what the postage rate would have to be in current dollars to keep pace with inflation at the end of the period. The 2003 pace value is the 2003 dollar adjusted figure for the denominated value. So three cents in 1932 is 40 cents in 2003.
My Wi-Fi news site has an incredible reporting system that I have access to via my content and advertising partner Jiwire. It’s called Omniture, and it can slice and dice and chart stats of all kinds. After reading yesterday that Firefox has nearly 5 percent of the browser marketshare (by usage) and Microsoft Internet Explorer has lost 5 percent of its share (from 95 to 90 percent) since May, I checked my stats.
Pretty astounding: at Wi-Fi Networking News, 22 percent of visitors in November use Mozilla (Gecko) which in Omniture’s reporting combines a variety of Mozilla engines. It’s mostly Firefox, I’d wager. Even more remarkable, IE 6 is just 64 percent. A full 5 percent use one of two recent versions of Apple’s Safari! (Opera is about 2 percent, IE 5.5 is 1.6 percent, Netscape 7 is 1.3 percent.)
Too much death and threats of death in a kiddy film. King Neptune was flat. Extended ice cream bar scene was extremely awesome, especially sugar-drunk SpongeBob behavior. Broken framing mechanism involving pirates abandoned by end. Scary parts which were unappealing. All major characters from series given cameo or highly limited roles—missing Sandy, especially, given that she’s a sea monster fighter. David Hasselhoff rocked, especially the long scene on his back, butt, and legs. I give it 3 chum buckets or 1 1/2 krabby patties.
I’ve put into place a throttling mechanism for my RSS feed from Wi-Fi Networking News. I’ll post the code soon. I use an Apache server and am essentially forcing through several RSS, RDF, and Atom feed files to be retrieved seamlessly through a script.
The script uses a MySQL database to record the agent name and IP address of requests. If the RSS feed hasn’t changed in the last hour or, if longer, since the last time the same IP and agent requested a feed, the RSS aggregator gets a 304 (not modified) instead of a full dump.
I’m willing to take a small hit on testing this—losing some RSS aggregators that don’t interpret this behavior correctly—in order to test whether I reduce my overall RSS feed suck.
As I noted a few days ago, my RSS feed from Wi-Fi Networking News (vast majority) is nearly an average of 400 MB per day. But a substantial minority of that is from stupid aggregators that don’t check for modifications, but always request the full feed.
This is my way of fooling them. We’ll see if it breaks anything, or just makes it more efficient.
Later: I have the early observations about which aggregators are really, really stinky at understanding what “please don’t retrieve a page because it hasn’t changed” means. I’m only intercepting GET requests, not HEAD requests, as I understand how Apache works, so I’m only recording hits from aggregators that keep taking and taking and taking bandwidth.
The top villains (and I’d be glad to get more information about them — please drop me a line). The fact that some of these appear multiple times means that they are being accessed from different IP addresses.
Great news/update (11/22)! The folks at Xmission, whose Xmission RPC Agent was one of my top offenders, responded to some email I wrote in which I asked them if they could take a look at how their engine works, and they said there was a bug causing this kind of repetition which they’ve fixed. What a win-win situation: they use less bandwidth and computational time, and I don’t lose readers! I’ve written the SmartBarXP people and hope to get a response from them, too.
Another update (later on 11/22): Greg from NewsGator wrote to find out why I was seeing such high usage from NewsGatorOnline. It’s a well-behaved ‘gator, it turns out: my script captures all GET requests, and the NewsGator makes all the right moves to not retrieve a non-modified page. But these are recorded in my logs as zero-byte 200 (OK) HTTP transactions. Thus NewsGatorOnline shows up with a lot of requests, but isn’t pulling down traffic. Scratch ‘em off the list!
|Agent name||Requests over a few hours|
|XMission RPC Agent Fixed! 11/22||253|
|NewsGatorOnline/2.0 Not a problem, turns out||19|
|curl/7.9.8 (i386-portbld-freebsd4.6.2) libcurl 7.9.8 (OpenSSL 0.9.6g) (ipv6 enabled)||15|
|SharpReader/0.9.4.1 (.NET CLR 1.1.4322.2032; WinNT 5.1.2600.0)||15|
It looks like my next plan may be to entirely block certain aggregators by replying with an XML “pllllllllhhhhbbbbtt” and an item encoded note saying, “Please ask your aggregator’s software developer to correct behavior in using requests to determine changed syndication feeds. You will then be allowed to use this feed again.” I might offend some readers, but it looks to me like I might save a number of gigabytes a month now and much more in the future as usage grows. If you use RSS with Wi-Fi Networking News, please let me know if you’re seeing errors, by the way.
Call me a switcher. I’ve been getting more and more angry at Safari’s lacks, and after Apple refreshed it slightly in the latest OS X upgrade, I’m still not impressed. Safari is very close to great, but they’re not putting enough time and effort into the little things that just add up to irritation.
I cannot get Safari to run for more than a little while without getting interludes of spinning rainbows. I know all the tricks, including disabling favicon downloads, reducing page load delay settings, and so forth. Nothing helps. Firefox has a few things that bug me, including a lack of keystroke commands—I’m sure I just need to dig deeper to find them or set them to my needs—but the rendering is fast and no spinning rainbows. It’s multi-threading (whether it’s real or just a programmatic illusion) means that it can render in one window while I switch to another.
I’ve now switched to Firefox on both my home and work machines. Once I moved into full-time Firefox, as opposed to testing it, I like it even more. Everything is snappier, and simpler. You can’t import bookmarks from Safari, which is silly and pointless.
Ironically, to make Firefox your default browser under Mac OS X, you have to run Safari, select Preferences, and set Default Web Browser to Firefox.
Lynn took the picture, and gets the photo credit of Ben and me on the profile page of Business 2.0’s latest issue. Kind of a neat three-fer.
I ran the calculations on how much bandwidth RSS aggregators are sucking from my Web server by scanning for retrievals of files named index.xml, index.rdf, rss.xml, atom.xml, and scriptingnews2.xml. I looked at just the HTTP code 200 transactions, not the 304 (no modification) retrievals which are just a handful of bytes. The chart is below:
Most of this RSS is for Wi-Fi Networking News; a tiny fraction for blog.glennf.com and a few other blogs. You can see the growth and the weekends pretty obviously—weekends make the most sense as I’m least likely to post updates, so well-behaved RSS aggregators are least likely to get changed files, while ill-behaved ones are more likely to be on computers that are turned off for the weekend. In early October, the weekday average was about 275 Mb; in mid-November, we’re up to 375 Mb. (BoingBoing linked to this post, and their own stats: They feed 50 Gb per month of news aggregator feeds — that’s more than they ship in HTML!)
Now my co-location host, digital.forest, has great bandwidth pricing: a buck a gig over the 80 Gb per machine that I have co-located. I transfer about 2 Gb per day in Web site traffic from the machine that’s now pushing out nearly half a gig in RSS traffic. I may have to build a custom RSS Apache doohickey that will force a 304 (no change) to an RSS aggregator if it doesn’t have an If-Modified-Since tag in its request.
I did a quick look at which aggregators represent the most traffic, and a very small number of users employing lwp-trivial, a perl-based HTTP query system, appear to be using over 10 percent of my RSS bandwidth! Time to fix their wagons, to be sure. It makes sense that various Mozilla browsers that have RSS support are using about 15 percent. NetNewsWire makes a very strong showing of 10 percent of usage lately. (Click image to see the full-sized chart; I dropped out days in which aggregators retrieve less than 7 MB, which is why you see some gaps. You can also see NetNewsWIre’s beta 6 adoption curve. If you have a better way to graph this, I’m open to it: click here to download the Excel file which generated this chart.)
I can tell that Mozilla-derivatives like Firefox and NetNewsWire are well behaved because the bandwidth-abusing aggregators don’t drop their traffic usage much on weekends; the well-behaved ones drop by about 80 percent. This could also indicate that the poorly behaved ones are more likely to be running on servers instead of on personal computers, too.
To cheer woes this November day, here is the greatest bad translation of a product manual ever created. I have a hard time believing the translator had more than a passing familiarity with English, or was viewing the entire project as a giant joke. The manual is for a bikestand that holds up to four bikes. It includes these gems:
And my favorite sequence of three signs indicating various safety problems:
Our president stated his goals very distinctly for his next term:
We will continue our economic progress. We will reform our outdated tax code. We will strengthen Social Security for the next generation.We will make public schools all they can be, and we will uphold our deepest values of family and faith.
Economic progress: More tax cuts increasing future deficits at the expense of the already wealthy. The averages will again be cited instead of the quintiles, showing disproportionate percentages of the refunds going to the wealthiest.
Outdated tax code: Easier ways to deduct for people who spend more, and thus can itemize better. Actually, I heard that the Bush administration is pushing a very good use of the Health Savings Account (HSA) program which allows tax-free accumulations of money used only for a variety of health-care purposes if you opt for a high-deductible health insurance program. There’s talk that HSAs for people below a certain income level would be seeded with $1,000 a year for insurance premiums among other benefits. HSAs primarily benefit people in a high-enough income bracket and with enough discretionary spending power to put money away and get a 25 percent or more “discount” on their saved cash. But this seeding of dollars towards health care for the working poor is a very good idea.
Social security: privatize as much as possible without addressing the shortfall of current obligations that’s growing and growing. I don’t mind the idea of allowing private management of funds to better own those funds, but existing obligations should be funded and met.
Public schools: No more funding, just a renewal of legislation, and more penalties without dollars to fight problems. Without money behind No Child Left Behind, charter schools gain momentum as do a move of parents and dollars to religious schools. This is a very clever multi-pronged approach that he’s been using successfully for his whole term.
Values of family and faith: Anti-gay marriage constitutional amendment. More blurring of church and state with faith-based initiative pushing. I thought conservatives wanted less control of their lives by big government?
I have to say that it’s refreshing that the agenda is no longer being cloaked. I mean, he’s using code words, but these code words are really straightforward ones. No compassionate conservatism, which meant nothing. These words means something and we can respond. This is kind of a relief.
I’m not profoundly depressed that Kerry didn’t win, and only slightly surprised after his surge the last few weeks. If the country had seen the man that won the debates and emerged in the last month for several months, the tide would have turned earlier, and he would have picked up enough votes in key states to have changed it around.
But it’s clear from Bush’s first term and from the plans that have been openly discussed about what to do with a strong mandate and a totally overwhelming lead in Congress for his second term that we aren’t going to see any cooperation at all. We have to fight for every last thing in every legal manner possible.
The fact that so many races were so close just shows that people who believe in equal treatment for people of all stripes and all income levels really do abound.
I have to say it is nice that there was a definitive winner. Some folks are raising the spector of Diebold stealing the election very subtly through evoting fraud because of the discrepencies in exit polling and actual voting in evoting and non-evoting districts and states. We’ll see what comes of it, but it’s certainly a better reflection of the failure of exit polling. I don’t believe that Diebold is organized enough to run a subtle conspiracy.
I just voted. Please remember to vote. Vote, vote, vote. Vote! But just once.
Remember: resoluteness in the face of disaster and ruin isn’t a virtue. Emerging ideals and policies that reflect a changing world is what we need right now.
My wife took this picture of her friends D.J. and Ken while skiing at Grand Targhee several years ago, and she’s prized it ever since because of the middle sign.
I mean, losing your life, okay, you’re a triple-diamond black skier, so you laugh at that because you can ski anything.
But they’re going to rip my ticket! Well, that’s serious.
October 2011 | August 2011 | June 2011 | May 2011 | February 2011 | December 2010 | November 2010 | October 2010 | September 2010 | August 2010 | July 2010 | June 2010 | May 2010 | April 2010 | January 2010 | December 2009 | November 2009 | October 2009 | September 2009 | August 2009 | July 2009 | May 2009 | April 2009 | March 2009 | February 2009 | January 2009 | December 2008 | November 2008 | October 2008 | September 2008 | August 2008 | July 2008 | June 2008 | May 2008 | April 2008 | March 2008 | February 2008 | January 2008 | December 2007 | November 2007 | October 2007 | September 2007 | August 2007 | July 2007 | June 2007 | May 2007 | April 2007 | March 2007 | February 2007 | January 2007 | December 2006 | November 2006 | October 2006 | September 2006 | August 2006 | July 2006 | June 2006 | May 2006 | April 2006 | March 2006 | February 2006 | January 2006 | December 2005 | November 2005 | October 2005 | September 2005 | August 2005 | July 2005 | June 2005 | May 2005 | April 2005 | March 2005 | February 2005 | January 2005 | December 2004 | November 2004 | October 2004 | September 2004 | August 2004 | July 2004 | June 2004 | May 2004 | April 2004 | March 2004 | February 2004 | January 2004 | December 2003 | November 2003 | October 2003 | September 2003 | August 2003 | July 2003 | June 2003 | May 2003 | April 2003 | March 2003 | February 2003 | January 2003 | December 2002 | November 2002 | October 2002 | September 2002 | August 2002 | July 2002 | June 2002 | May 2002 | April 2002 | March 2002 | February 2002 | January 2002 | December 2001 | November 2001 | October 2001 |