Powers Unfiltered

OK, it’s “Blog Against Poverty Day,” and while I rarely participate in such blogging “days” (mostly out of disorganization), this seems a good time to share my experiences with Kiva.

This month, we are all learning (often to our dismay) just how connected our financial well-being is to decisions made by far-off strangers.  We can see now that poor decisions in New York and London can lead to financial pain around the world – and in our local communities.

But fortunately, the opposite is also true – a few good decisions locally can lead to great benefits around the world.

Early this year I heard about an organization called Kiva, which helps to organize loans for small businesses in developing countries – a practice known as “microlending,” part of the growing area of “microfinance.”  What interested me about Kiva was its funding source – individuals, recruited through its Web site.  I checked it out – and was soon lending money to store owners in Tanzania and farmers in Peru, a few dollars at a time.  I recently made my 100th loan on Kiva – many of which have already been repaid in full, and none of which have defaulted to date.

Through a combination of their growing army of individual lenders and their association with local microfinance organizations, Kiva has opened up a new way for entrepreneurs in developing countries to access the capital they need to grow their small businesses.  And those connections start here – I’ve seen other lenders on Kiva.org from my own home town of Lafayette, and from other nearby communities.

I really like what Kiva is doing – but more than that, I also really appreciate the fact that many, many organizations throughout the world are not waiting for a government bailout, are not intimidated by the scope of the problems they face, but instead are bringing innovative solutions to every corner of the globe.  As a result, while we may be connected to AIG and Lehman Brothers in ways not of our own choosing, we can also choose to connect to a store owner in Tanzania or a farmer in Peru.

After two years of testing the promises, wishes and hopes of the Microsoft AdCenter team, and thousands of dollars spent to no avail, Digipede is done with Microsoft’s online advertising.

I, CEO of a Microsoft Gold Certified Partner, do hereby proclaim my opinion, based on firsthand experience, that Microsoft AdCenter is entirely without value to our company, inferior in every measurable way to competing offerings from Google and even Yahoo, and a time-and-money sink of unusual scope, even for Microsoft.

I ran the campaigns myself, took advantage of consulting and optimization offers, tweaked and twiddled the knobs and dials on all three platforms, spent money on all three platforms, and Microsoft is — third.  Distant third.

I posted about AdCenter more than two years ago, and the improvements since that time have been numerous — and meaningless, from the perspective of actual business performance.  I’ve heard Gates and Ballmer and others brag about newer and better algorithms for their advertising platform more times than I can count, and I’ve seen no improvement in clickthrus from prospective customers.

Microsoft’s search engine is fine — it’s come a long way in the last few years, and is now nearly as good as Google in most ways.   But something is desperately wrong with (a) the ad placement algorithms or (b) the way those ads are displayed or (c) the audience that uses Live Search or (d) all of the above, because the right people click through to us from ads placed by Google, and they don’t from ads placed by Microsoft.

Of additional concern is the apparently defective billing mechanism, which (in my experience) continued to bill my account after all campaigns have been paused.  (OK, possibly I screwed up in some way using the less-than-intuitive AdCenter interface, which I find clumsier than its competitors, and somehow missed pausing something — although I doubt it.)  Last week I finished working through this last minor billing issue with a very helpful and friendly Microsoft representative (I’m screwed, but only out of about $80 — nothing compared to the losses from legitimate bills), and have shut down our account.

Anyone from Microsoft is free to call me about our experience with your online advertising service — I’m at 510-834-3645 ext. 101 — just so long as the call does not present me with new opportunities to use this offering.  We’re done with it.

OK, this one came out while I was on vacation, so it’s a little old, but I can’t let it pass.

The new head of Red Hat, Jim Whitehurst, says “The clouds will all run Linux.”

Really? What’s next? The head of Boeing telling us that all transportation will be via 787s? Or maybe a statement from OPEC saying that cars will all burn gasoline?

Get serious. “The Clouds” will run Linux and UNIX and Windows and OS X and whatever else paying customers want.

“The Clouds” are already running more than just Linux, and if cloud computing is going to grow beyond today’s super-early-adopter proof-of-concept market, it’s going to get more diverse, not less.

Every time there’s a new IT buzzword (oops, I mean “revolution”), some market-oblivious engineer or attention-deficit analyst declares that finally legacy computing is dead, a new paradigm is here, there’s One Right Way to do everything now, the open-source rapture is at hand, you’re free from your chains, yada yada yada.

But a guy like Jim Whitehurst should know better.  Yeah Jim, “the clouds” are going to kill Microsoft. Yeah Jim, “the clouds” mean Oracle is finished. Yeah Jim, “the clouds” will all run Linux, and Slashdot will replace all other news outlets.

I’ll have lots more constructive things to say about cloud computing soon here, but for now let me just say: the cloud computing offerings I’ve seen so far look a lot like computing. There’s hardware infrastructure, there are operating systems, there are development tools, there are applications, APIs, and user interfaces. There are administrative tools, management consoles, and buckets of kludgy tricks to make anything actually work the way you want it to work. Different vendors expose different parts of all this to their users in different ways as they struggle to differentiate. But anyone who believes that “the clouds” will “all” standardize on a single OS (or database, or programming language, or much of anything else) is just blowing smoke.

The San Francisco Chronicle is not exactly the planet’s leading source of technology news and analysis.  So many of you probably haven’t yet seen Deborah Gage’s excellent article today about Dan’l Lewin, Microsoft’s ambassador to Silicon Valley.  Dan’l is among our most important contacts (and favorite people) at Microsoft, and despite his high-visibility role, many people (including many entrepreneurs) still don’t understand the value he can bring to a startup.

In a single sentence containing at least three significant understatements, Ms. Gage writes:

Microsoft still gets criticized sometimes for being slow to the Internet or hard to do business with, but Lewin has won praise over the years for his courtesy, efficiency and ability to connect outsiders to the right people inside Microsoft, which is not an easy task.

Whew.  Let’s parse that.

“Microsoft still gets criticized sometimes for being . . . hard to do business with . . .”  There is no question that doing business with ANY huge company is hard.  Building a close relationship with Microsoft (or any tech giant) is not for the faint of heart.  Microsoft presents some special challenges that I could go on about at length (oh wait, I’ve done that multiple times…), but let’s just stipulate that some of these criticisms are justified while some are not.

“…but Lewin has won praise over the years for his courtesy, efficiency and ability to connect outsiders to the right people inside Microsoft…”   Bingo.  Dan’l Lewin has done more to expose the helpful side of Microsoft to startups, entrepreneurs, and VCs than anyone would have thought possible just a few years ago.  His Emerging Business Team is the API for startups that want hooks into Microsoft.  Digipede has received numerous tangible and intangible benefits from working with the EBT; the group brings the attitude that they can’t wait to help interesting startups, and it’s Dan’l who sets the tone and agenda for that critical group.

“…which is not an easy task.”  No kidding.  I’m back to my API analogy.  If you would rather to try to reverse-engineer the Microsoft org chart from the outside, good luck — but a single call to the EBT can get you to the right person within Microsoft faster than any other method I know.

The Bay Area is teaming with “experts” who would have us believe that Microsoft has become irrelevant.  In my experience, entrepreneurs ignore Microsoft at their peril.  Far better to understand what they’re doing and why than to pretend they aren’t there.  Dan’l and his team are great resources for entrepreneurs who want to understand and work with Microsoft.  So — good job, Ms. Gage, for profiling Microsoft’s local champion of innovation.  Well worth reading.

As I wrote earlier this month, the Powers household is now generating some of its own electricity, via photovoltaic panels on the roof.  Soon after the installation, our local utility PG&E installed a spiffy new digital meter and certified the system for use.  I turned it on last Thursday afternoon.  Yesterday afternoon (one week later) I played around with the power inverter to see the cumulative energy production since the system was turned on.

In exactly one week of long, sunny days, the system of 18 panels produced 154 kWh — or 22 kWh per day.  In that same period (which included some nice days and some very hot days — it was over 100 degrees F at our house yesterday), the new meter tells me that our house used all that plus 151 kWh more from the grid.  So even with the pool filter running and above-normal air conditioner usage, the solar panels produced almost exactly half the electricity used by our large-ish suburban California home.  Not bad, given that we could only put solar panels on a relatively small fraction of the roof (too much shade on the rest of it).

More economic analysis to follow after I get a bill or two.

The world is indeed getting smaller — and quicker, and better connected. And you might as well talk about what you’re doing, because smart well-connected people will figure everything out immediately anyway.

Case in point: Marc Adler’s recent post about Velocity, in which he says:

. . . It is no secret that the most prevelant use of object caches on Wall Street is with Grid Computing. How will Velocity interface with Compute Cluster? How about Digipede (if I know John Powers, he probably has support for Velocity already)?

Well, Marc, if you’re going to post on Sunday mornings, you may not get instant confirmation of your clever guesses, but now it’s Monday afternoon, so I can confirm — yes, we have a working PoC in the lab at Digipede, proving (to ourselves at least) that the Digipede Network and Velocity work great together. And yes, it provides significant performance improvements for certain types of activities important to Wall Street folk.

If anyone is still wondering why we chose .NET as the basis for our grid computing software, this is just the latest example — Microsoft just keeps giving us great free stuff on which to build. The Velocity CTP came out last week; this week, we have working code that provides real benefits.

Rob just posted his initial comments; there will be more.  And we’ll have feedback for the Velocity team.  Watch this space (and Rob’s, and Dan’s…).

I can’t believe I still haven’t had a chance to write about Velocity, Microsoft’s recently announced in-memory cache.  I think  this is just further proof that I have an endless backlog of topics about which I should be writing.

In any case, Derrick Harris of Grid Today has done a great job of connecting the dots for us in his excellent article today.  Read the whole article, because he offers good insight on how important this announcement really is, but here’s his analysis of how it affects Digipede:

Whatever emerges from Velocity also should be good news to Microsoft’s technology partners — in particular Digipede, which has been delivering distributed computing to .NET apps and now might get the add-on technology it needs to compete with the big boys. Digipede has received no shortage of praise from customers and commentators alike about its relatively inexpensive and very user-friendly solution, but one of the drawbacks has been its limitation in terms of what types of jobs the Digipede Network can handle, namely CPU-intensive jobs benefitting from parallel processing. If Microsoft and Digipede can make Velocity and the Digipede Network function as a unit and keep the price down, Digipede could find itself selling to a whole new, real-time-data-loving audience. That this integration will occur is pure speculation on my part, but it seems to make sense on the surface.

I have no comment on specifics at the moment, but let’s just say — Derrick, you nailed it.

Digipede CTO Robert Anderson is blogging about a recent experiment we’ve conducted in our lab, assessing what it would take to get the Digipede Agent running on Mono. (For those of you who don’t know, Mono is a cross-platform implementation of .NET, developed as an open-source project led by Miguel de Icaza, and sponsored by Novell.)

And as he reports, thanks to improvements in both Mono and the Digipede Network, the answer is — not much. We’ve got a working prototype of a Digipede Agent running under Mono on Linux that runs a Digipede job.

Digipede on Linux? Has the world turned upside down?

Hardly.

Since the beginning, Digipede has been focussed on adding value to the Microsoft platform. And customers know that. Customers also understand that Microsoft is getting better and better at making sure its products interoperate with others, even on other platforms, and Microsoft’s partners have to facilitate that. We get questions from customers pretty frequently about Mono, and lately those questions have gotten more specific, so it seems prudent to investigate any technical blockers from time to time.

So let me re-state what Robert said, and what I said above — this is an initial assessment, a technical experiment only, not a shipping product.  Rob’s post (and mine) are not a product announcement — this is a blatant “trial balloon.”  We want to hear what the market thinks of Digipede on Mono.

Why might this be interesting? Let’s back up a step and take a look at enterprise grid and HPC deployments.

Most enterprise customers have what is often called a “mixed” IT environment. That’s a euphemism for an unplanned and chaotic assortment of technologies that have piled up over the years into some type of barely-managed infrastructure. In almost every enterprise, Windows runs on most or all of the desktops. In almost every enterprise, there is some mixture of Windows and Linux servers, with maybe some Solaris and/or other UNIX flavor(s) thrown in. In almost every enterprise with an HPC infrastructure, most or all HPC nodes run Linux.

This is just reality — Windows is miles ahead in 2008 desktop market share, and Linux is miles ahead in 2008 HPC market share. Do I wish it were different? Sure — if Microsoft had a bigger share of the HPC market (and we’ve been working diligently to help make that happen), we’d have an even bigger market into which we could sell our software. And that will happen, I have no doubt. We tell all our customers “Windows HPC Server is the best option for adding power to a Digipede grid,” and that’s the truth. Go buy some now.

But the fact remains, there’s a lot of existing infrastructure — desktops, 32-bit Windows servers, Linux servers and cluster nodes, Solaris servers, and more — that enterprises are not going to throw away.  All this infrastructure represents potential grid computing power.  The Digipede Network has always run on heterogeneous Windows networks — with Agents running on 32- and 64-bit Windows desktops, 32- and 64-bit Windows servers, and cluster nodes running Windows HPC Server (formerly Compute Cluster Server). Our reluctance to include boxes that don’t run Windows has always been mostly about applications — it’s still relatively rare to find applications that are actually deployed across multiple operating systems simultaneously.

But as Mono gets better and better, we hear from enterprise customers and prospects who are getting more interested in it. They like the idea of being able to use more of their existing infrastructure more efficiently. They want to take advantage of Digipede’s great developer experience to deploy more applications — with minimal changes to that infrastructure.

So let’s get back to Robert’s closing question: “Now that we can do it, what should we do with it?” What do you think? Is the market crying out for a multi-OS .NET grid? Or is what we’re hearing just idle curiosity?  Let’s hear from all sides.

Releasing software is hard.

Sure, the individual steps like specifying, developing, testing, documenting, and planning support for new software features are difficult enough — but the discipline of knowing when to STOP adding features, and to focus instead on finishing a complete, polished, release-ready product is tougher than it sounds to those outside the industry.

In any software organization worthy of the name, there are more good ideas than can possibly be put into any specific product release. There are also just a stunning number of bad ideas competing for inclusion in shipping products (I am notorious within Digipede for proposing needlessly specific bad ideas. Mercifully, my partners of 20 years have honed their skills in talking me out of the worst of them.)

We decided early on at Digipede that our feature set would be guided by three principles: Performance, simplicity, and a focus on adding value to the Microsoft platform. Over the past five years, these principles have helped us make decisions on what to include (and as importantly, what to exclude) from our software.

Last month, we reached general availability of the latest release of the Digipede Network, Version 2.1. You can see what’s new in this release on our Web site, but now that our customers have had an opportunity to upgrade, let’s look at a few of the specific new features to see how we did in sticking to those principles:

Job concurrency: The improved Digipede Agent software can manage different applications running simultaneously on multiple cores of a single compute node, maximizing utilization of compute nodes on the grid. Users can set Job Concurrency values to allow the Digipede Agents to work on multiple jobs simultaneously: designate which applications can safely run with other applications, which applications can run side-by-side with themselves, and which applications are not compatible for concurrent jobs.

Performance! This one is just amazing. As new machines ship with more and more cores inside, I am continually baffled at the lack of attention from ALL the major vendors out there about how to take advantage of those cores. Sure, Intel talks about compilers and Microsoft talks about Parallel Extensions and so on — but in shipping products in 2008, there’s just incredibly little help for users and developers who want to take advantage of multi-core processors. What we shipped in Version 2.0 last September is still miles ahead of other software options in terms of both development patterns and execution modes for multi-core processing. With Version 2.1, we’ve extended that lead significantly — if you want to take advantage of dual-CPU quad-core servers and desktops TODAY, you need to take a look at how the Digipede Network handles concurrency. Watch the 4-minute video that shows how, then get an evaluation copy of the software and try it yourself!

Management APIs: New management APIs give developers programmatic ability to create, modify, and delete resource pools. (Available in Professional Edition only)

Performance (specifically, scalability), and Simplicity (of grid management). A browser-based UI for grid management is great — for small grids. As our customers deploy larger and larger grids, they need both the browser-based UI of Digipede Control and a wider range of tools for the programmatic manipulation of grid resources. It is vastly simpler to take advantage of thousands of grid nodes through simple extensions to our management API.

Risk-free sharing: “Pool Rank” permits risk-free sharing of resources: you can add your servers to the enterprise grid and ensure that they always work on your jobs first. That means that by joining the grid, you can only improve your application performance. You can donate your cycles when you are not using them without worrying that your application performance will degrade, because you are always guaranteed that your machines will work for you.

Performance and Simplicity. We’ve also referred to this feature as “Selfish sharing.” We hear from other grid vendors about how users “must” get over the practice of “server hugging.” We try not to be so arrogant; we’ve never found that scolding our customers is good business practice. If customers want to preserve unconditional priority on their own servers, we say “good for them.” So we’ve built a straighforward way to preserve absolute priority for the resource owner, even when they offer to share surplus resources. From what our customers tell us, we think this approach encourages efficient resource sharing far more than lecturing ever would.

First Grid Computing Solution Certified for Windows Server 2008: We followed the long and winding road of the Early Adopter program to become the first grid solution to obtain this important certification, so that customers can be confident that our software works not only with the Microsoft products they use today, but with all the latest improvements Microsoft is bringing to market now.

Performance, Simplicity, and Microsoft focus. By aligning with Microsoft’s technology and strategy, we help our customers create a truly dynamic IT infrastructure. Server 2008 brings many benefits in performance and manageability, and we’re confident that our customers will be upgrading quickly (more quickly than, say, to Vista); we want to be sure they can use our latest capabilities on Microsoft’s best OS platform.

Let me be candid here; these benefits do not come free to ISVs. I have considerable anxiety over extending yet further the number of versions of Microsoft products we support — for example, while I think Server 2008 is great, and Visual Studio 2008 is great, and the new SQL Server 2008 will be great, staying current means we’ll have to start enforcing our requirements by turning away requests for support of Windows 2000 and SQL Server 2000. The combinatorics for testing on multiple OS versions, .NET versions, SQL Server versions, IIS versions, and upgrade paths for our own software versions get out of hand quickly. I’ll have more on this issue another day. For now I’ll just say I’m happy with our decision to stay current — mostly.

Automatic Failover Package and Integration with NLB: Failover has long been a feature of the Digipede Network Professional Edition but with the optional Automatic Failover Package, organizations can now have complete out-of-the-box integration with Windows Server 2008 load balancing, giving “hands-free” failover to mission-critical applications.

Performance, Simplicity, and Microsoft focus — yes, even this advanced capability was guided by our goal of simplicity. While automatic failover is often considered a complex requirement, we made some basic decisions to keep it as simple as possible. First, we made automatic failover it’s own SKU, so customers without the need for high-availability configuration don’t even have to think about it. Second, we did away with a lot of the manual scripting that often slows implementation of failover solutions — you can have it running very quickly. Finally, we left as much as possible to popular existing technologies — SQL clustering and NLB — so the implementation steps will be as familiar as possible.

Reports Package: Assembles critical information about the use and optimization of the grid, with easy-to-understand charts and graphs, flagging of critical information, and drill-down capability, giving enterprises fully integrated optimization of grid performance, with tracking of who contributes to and who benefits from grid resources.

Performance, Simplicity, and Microsoft focus — In larger systems, simple and informative visual tools are essential for wringing the most performance possible from a grid. Users and administrators become far more productive in their routine monitoring functions and troubleshooting activities with this new package, which plugs directly into Digipede Control (our admin UI). And by building on SQL Reporting, we’ve created a framework for future extensions.

Overall, I’m pleased with the extent to which we have driven the improvement of our product by staying focused on the three principles described above. To be a little less self-congratulatory, I wish we had stopped adding features at least two months earlier and brought most of these capabilities to market sooner, rather than piling quite so much into a single release (and there’s certainly more than I’ve had a chance to discuss here).  Perhaps another day, I’ll have a chance to discuss some of the things we (purposely) left out!  Now that V2.1 is in the market (and getting rave reviews from our customers), I’m eager to see what great new applications our imaginative customers create and deploy on our latest platform.

Late this winter, we had a whopper of a Pacific storm, and it became clear that the Powers Roof had reached the end of its useful life. (The weather inside may not have been as bad as the weather outside, but it was bad enough.)

This wonderful opportunity led to the “while-we’re-at-it” syndrome that plagues so many home repair / improvement projects. So while we’re replacing the roof — why not investigate installing a photovoltaic system at the same time?

And after a bit of analysis (more on that another day), we decided to go for it. The process of collecting bids and testimonials went smoothly (hint — the housing market really is as soft as people say; contractors are hungry!), and after a bit of permitting and paperwork — BAM, new roof and new solar panels. From two signed contracts (roofer and solar guys) to completed project took less than 10 days, including Memorial Day weekend. PG&E will be out “soon”with a new meter, and we’ll be getting about half our electricity from the sun.

The whole system will pay for itself in about 8 years (given California’s outrageous electric rates), and we’ll take a few toes off our carbon footprint.

Panels like these were quite rare even here in California even 2-3 years ago. Now, they’re popping up all over. The California Healthcare Foundation (where Marian works) just put up a 100 KW system, which is 30 times the capacity of ours. Google put in a 1.6 MW system a year or two ago. Walmart has started putting them on stores here. It’s not enough to account for much power yet, but it’s a big change in a short time.

If you want to find out how solar might work for you, call Jason at Borrego Solar, and tell him I sent you — they did a great job (and no, I don’t have any financial interest in Borrego).