Redmond Diary

By Andrew J. Brust

View all blogs

Ozzie Leaves Microsoft: Chief Software Adieu

I'm writing this post from Bulgaria, where the annual DevReach conference is taking place. A number of well-known American and Canadian speakers from the Microsoft-focused conference world are here with me. The combination of speakers who have known each other for a while and an unusual location for their gathering typically makes for camaraderie, and a lot of discussion. Before long, that discussion usually turns into an industry analysis bull session. And just two days ago, we had such a bull session, focusing on Ray Ozzie.

We all remarked that we hadn't heard much from Ozzie lately, and that he never really seemed to fit in at the company. In fact, we felt his aloofness may have been responsible, in part, for allowing the migration of Windows Live Spaces to WordPress.com. Bill Gates never would have let that happen, we reasoned. But his, successor, Ray Ozzie, apparently didn't care. We wondered what was keeping Ozzie at Microsoft. We wondered why he wanted to stay, and why Microsoft wanted him to stay. Regardless of the reason, we reckoned it wouldn't, and couldn't, last much longer.

It turns out Bulgaria is seven hours ahead of Eastern time. So when we returned home from a late dinner last night, we got back just in time to read the news of Ozzie's resignation from Microsoft.

Aside from feeling a bit smug at our clairvoyance, we've had remarkably little conversation about the news today. What we have discussed is that no one sees Ozzie's announcement (or, rather, Ballmer's announcement of Ozzie's decision) as bad news. While none of us is happy about the volume of high-profile departures at Microsoft of late, none of us is especially upset about this one.

Ozzie's vision for Microsoft, that it embrace services and make a big bet on the cloud, was good, as far as it went. But when the "We're All In" speech took place in March at the University of Washington, it was Steve Ballmer, not Ray Ozzie, who delivered the address. Ozzie sat in the front row, looking on as someone else articulated his own vision. Microsoft needs a technical visionary who aspires to more than working behind the scenes. Ozzie's stepping down may enable such a visionary to step up.

I would have thought such a visionary would assume the Chief Software Architect post, but Ballmer has stated explicitly that he will not be hiring anyone new into that title. I find this odd. Someone needs to step into the role of technical thought leader at Microsoft, and take full ownership of the role and its responsibilities. That role, clearly, will not be called Chief Software Architect.

But hopefully it will be called something. Because not heeding that call has created problems for Microsoft. And these are problems it can and should overcome.

Posted on 10/19/20102 comments


Treating Small Partners Right

For companies that are Microsoft partners, there has been change in the wind for some time. Ever since last year's Microsoft Worldwide Partner Conference (WPC) in New Orleans, Microsoft has made it clear it thinks that it has too many partners and that those partners are too small.

Since WPC '09, the Enterprise and Partner Group (EPG) has focused strongly on Global Systems Integrators (SIs) like HP and CapGemini, and much less on smaller or regional SIs. From WPC '09 onwards, Microsoft said smaller partners would need to be credentialed in specific competencies, with much more stringent requirements than before.

The days of scraping together certifications and customer references, for projects which largely fell under specific technology areas, in order to earn a generic Gold Partner designation, are just about gone.

The New Normal
In theory this will focus Microsoft's Partner Account Managers (PAMs) more efficiently. They'll be spending more time with fewer partners, and Microsoft will get more out of those partners. Global SIs tend to sell software licenses with their deals; and now even smaller partners will need to sell, or influence the sales of, licenses in order to earn or maintain their credentialed competencies.

This will, of course, make it harder for specialist application development consultancies to work closely with Microsoft. Their customers tend to have the licensed products in place already; that's why they call these shops in to develop apps for them. In fact, many smaller shops do dev work for business units within large enterprise customers. These clients tend to buy their Microsoft software through Enterprise Agreements (EAs) and the business unit customers tend to be downstream from the procurement process in any case. And smaller partners who do great things for these customers will fall off Microsoft's radar.

Honestly, dev shops that serve such customers will feel more like lonely fans than well-regarded partners. More of them will have "tele-PAMs" with whom they'll work over the phone and email. Many of them won't even have that. The Microsoft Partner Network (MPN), which replaced the Microsoft Partner Program last year, will change the ecosystem for good.

Understanding the Reasons; Contemplating a Solution
Whether partners like these changes or not, they shouldn't be surprised by them. Microsoft's COO, Kevin Turner, came from Wal-Mart. Given the raw efficiency with which that company is run, changes at Microsoft to improve license sales, and the ROI of working with partners, were bound to come. Turner views it as his job to make such changes, and Microsoft clearly wanted these changes or they would not have hired him.

Microsoft is a big business; no one should be shocked that Turner's trying to run it as other big businesses are run. Protesting these changes as unfair will get partners nowhere, fast. Making a business case for the small partners, and why their inclusion in the MPN is crucial, seems like a better bet. Can such a case be made?

Microsoft is a big business, but it is also a technology business. Leadership in tech is often determined by influencers in the tech community. Influencers tend to be entrepreneurial and run their own small firms. And those firms are just the type to find the MPN changes disadvantageous to them. While managing a herd of these partner companies is understandably difficult, working closely with a group of them, and encouraging others to rise to their level, would be a smart thing for Microsoft to do.

Brass Tacks
Microsoft needs to create a special partner category for influencers' shops. Rather than measuring them by licenses sold or influenced, it should monitor the Microsoft partner satisfaction they engender, and the utilization of EA-licensed products they help drive.

Microsoft should have the principals of these firms demo products and provide thought leadership. They should connect them with customers strategically. They should bring them into early adopter programs. They should treat them well. Doing so doesn't invoke wasteful cost; it provides for cost-effective marketing and customer outreach.

Sure, the Global SIs need to be courted more actively, but the game need not be zero-sum. Smaller shops that love your platform are valuable too. Microsoft historically has understood that. It has understood this better than IBM. Better than Sun. Better than Oracle. And rather than seeking to emulate those companies (imperfectly), Microsoft should use some of those companies' effective ideas combined with those of its own.

Another recent MPN change is in its leader: Jon Roskill, a Microsoft veteran who was once general manager of Developer and .NET Enterprise Server marketing, took over the Worldwide Partner Group from Allison Watson this summer. Given his background, I think Jon Roskill understands the value of smaller partners. I also think he should better explain that value to Kevin Turner and articulate a reminder of that value to Steve Ballmer.

Messing this up is easy, but getting it right isn't that hard. I hope it goes the way it should. Success for Microsoft and its partners hangs in the balance.

Posted on 10/05/20103 comments


So Long Oslo, We Hardly Knew Ye

I returned just last night from a short trip to Redmond. While I was there, I learned some news that I wanted to share, but I wasn't permitted to. But today the news was made public: Oslo, once destined to be a full-fledged wave of Microsoft technologies that would facilitate and promote model driven-development, is dead. The Oslo name summons Shakespearean images of King Hamlet slaying his Norwegian foe. But even without such literary context, the fall of Oslo is quite dramatic. And it's important to consider what happened, post mortem, as it were.

First let's be clear: officially, Oslo is only two-thirds dead. The final definition of Oslo was a product that would encompass a repository, a modeling tool (called Quadrant) and a modeling language, called "M." "M" is not dead. It may be granted a reprieve. But, if you ask me, it's still on death row. And if it survives commercially, I think it will take a different form, and might be only a minor ingredient in a much bigger recipe.

Let's be clear about something else, too: Oslo was impressive. True, it began as a watershed initiative of the now-defunct Connected Systems Division (CSD) at Microsoft, intended as a complete application development paradigm shift. And, yes, it was eventually whittled down to something that was much more modest, with the CSD team that launched Oslo becoming embedded into the SQL Server team, and curating the project under the moniker SQL Server Modeling Services. That was a come down. No doubt.

But Quadrant was neat. It had this great visual design surface that generated declarative M code and, eventually, imperative T-SQL code. It possessed a kernel of something breakthrough. It delivered what in my opinion Entity Framework still has not: a tool and a syntax for expressing entities as they are, and code that expresses those entities' concrete manifestation in the database. Nice.

So why did Oslo fail? I think for two major reasons. First, it was launched with so much fanfare, at a time when so little was built, that it developed in an amniotic fluid of hype. That encouraged the press, the market and the ecosystem to have unreasonable expectations that were impossible to live up to. And it probably caused the team to do likewise. Hyping things makes delivery goals unattainable. And the distraction of hype makes even attainable goals go unrealized. It really just sets things up for failure.

The other major reason Oslo fell short, I believe, was the innovation it actually did achieve. Oslo was developed on the presumptuous premise that business software developers would adopt it simply because it was innovative. Purist innovation isn't a bad thing, but it's the province of research projects, not commercial product development. CSD wasn't MSR (Microsoft Research). And now it isn't anything.

The best Microsoft initiatives come from product groups that are busy, work hard, and stay pretty quiet until they're almost done. That's what happened with Windows 7. That may well happen with Windows Phone 7 too. The best teams build and ship. The others talk and demo. It's not the same. It's not as good. And the market won't accept it.

Microsoft should do some damage control on this. Consider open sourcing M. As Chris Woodruff tweeted, consider open sourcing Quadrant too. Get some community good will from the good science and innovation in the technology.

And then move on. Diligently, humbly, and with clear goals around what comes next.

Posted on 09/24/20100 comments


Why PowerPivot is a Microsoft Bright Spot

For those who haven't come across it, PowerPivot is Microsoft's Excel- and SharePoint-based self-service BI tool. Essentially, it allows power users to build their own SQL Server Analysis Services cubes, except that they don't need to be familiar with cube concepts and they won't even notice that SSAS is involved. The other exception from the Microsoft BI norm is that these cubes use a new columnar, in-memory storage engine, called VertiPaq, rather than Analysis Services' traditional MOLAP (Multidimensional OnLine Analytical Processing) storage scheme.

This combination yields cubes that are far easier to build and, for power user scenarios, better-performing, even on commodity hardware. Add to all this a new Excel formula-like analytical calculations language called DAX (Data Analysis eXpressions) and PowerPivot is easily the biggest change to Microsoft BI since the 2005 version of Analysis Services was introduced, and maybe even since the original SQL Server 7 OLAP Services release in 1998.

I'm a big fan of the product. In addition to doing presentations on PowerPivot around the country since it was available in beta, an article of mine on it was recently published, and I did an O'Reilly Webcast on PowerPivot as well. And there's more to come. Feature set aside though, I think PowerPivot is incredibly important to Microsoft, for several reasons.

First, PowerPivot makes Microsoft BI competitive in a market that seems obsessed with in-memory databases. Next, the PowerPivot product has, among others, two powerhouse Microsoft BI figures behind it: Amir Netz, a founding father of the OLAP Services/Analysis Services product, and Donald Farmer, a dynamo of brilliance and enthusiasm in a company that has sustained significant losses in both.

Netz's and Farmer's hard work has not been in vain. PowerPivot has been growing community and expertise around it. Sites like www.powerpivot-info.com, www.powerpivotpro.com and www.powerpivottwins.com are just a few examples of this.

But perhaps most important, with PowerPivot Microsoft has crafted an important new product, and positioned it as part of the Office and SharePoint juggernaut. In so doing, Microsoft has made peace with the value of its more staid and entrenched products in general, the value of Excel to the BI market specifically, and it has learned how to innovate within the framework these products provide.

The PowerPivot story is about Microsoft drawing on its strengths. And it did that because the team behind PowerPivot was introspective and genuine about what those strengths are: creating software that works well, empowers end-users, leverages the value of PCs and their local processing power, sets standards and does it with the most compelling economics in the business.

My hope is that additional PowerPivot-esque initiatives are undertaken. Microsoft needs a lot more of them.

Posted on 09/09/20102 comments


Windows Live: Don't Live and Let Die

Windows Live has had many lives. It started as a single page at www.live.com, where you could set up various widgets in a tiled configuration. The widgets mostly consumed RSS feeds and the idea was that you could have a home page where the content updated dynamically; i.e. where the content was "live." I remember when the service was still in Beta and called Start.com; Robert Scoble, then a Microsoft employee, was hawking it pretty hard. It was kind of cool for its time, but it petered out, as did Scoble's stint at Microsoft a year later.

The next phase of Live saw the brand applied to a number of services and to Internet properties that had already existed under the MSN brand. MSN Messenger became Windows Live Messenger (after a brief stint as .NET Messenger -- don't get me started on that one). MSN Spaces became Windows Live Spaces. Oddly, the original www.live.com page went the other way and is now my.msn.com, but still, you get the idea. Redmond thought The Butterfly wasn't flying high enough, and that applying the Windows brand to some its properties might give them new life.

Except the Windows brand was intermittent. Some properties had the "Live" moniker without the "Windows" prefix on it (Live Mesh, for example); others had the full formal Windows Live name, and others had both (Windows Live Search became plain old Live Search, before it died and was reincarnated as Bing, and Bing Maps had a similar branding lineage). The difference between Live and Windows Live just wasn't clear. It still isn't: the new Windows Phone 7 will feature Live tiles.

This reminds me quite a lot of Microsoft's inconsistent usage of "Active" and "ActiveX" in the 1990s. I am still not clear on whether ActiveX controls could be hosted on the Active Desktop, and for a while Chris Kinsman and I presented a Web development workshop at VBITS (now Visual Studio Live) on both VB6 ActiveX Documents and Active Server Pages, since both held out promise. The branding police were a bit... ahem... passive in those days.

When Windows Live Waves 2 and 3 came about, it really looked to me like Microsoft was heeding the NYC Subway conductor's call: "Step lively." The brand got cleaned up, the developer story got serious with APIs and .NET controls, both for ASP.NET and Windows Forms (not to mention support for non-Windows platforms), and under the leadership of younger people like Chris Jones and Angus Logan, the network got a lot hipper, with Live ID (formerly Passport) support for OpenID, its own social network, and FriendFeed-like connections to other social networks, including Twitter, Facebook and now 36 others. Sure, there were still autonomous brands out there, like Hotmail and SkyDrive, but they were reigned in, with Windows Live becoming the "parent" brand and bestowing on them the same look and feel as the other WL properties.

The addition of Windows Live Essentials, the suite of Windows desktop applications that acted as companions to the online WL products, made the story even better. Windows Live Essentials, of course, included not just the WL Messenger IM client, but a revamped Outlook Express in Windows Live Mail, an enhanced Office Picture Manager in WL Photo Gallery, an updated Windows Movie Maker in WL Movie Maker, a new blogging tool in Windows Live Writer (with which I am writing this very post), an updated MSN Toolbar in WL Toolbar, and a new child browsing safety product called WL Family Safety.

Windows Live Essentials, in one fell swoop, accomplished several things: it brought badly needed updates to various desktop applications; it separated them from Windows proper, which allowed for more frequent updates, and less hassle from the DOJ, EU and other regulatory bodies; and it provided an excellent mechanism by which to distribute the Silverlight runtime and make its installed base significant. Also, by offering desktop apps that acted as companions to online offerings (Windows Live Mail for Hotmail, Photo Gallery for WL Photos, WL Writer for WL Spaces, and contact sharing between WL Messenger buddies and contacts on the WL social network), Microsoft showed in a practical way how the "Software Plus Services" vision could work. The client apps really did (and do) make the online properties more usable, and more fun.

It's been a while though. While WL Wave 4's release is imminent, its release will still mark over a year between waves. The dot-com bubble phrase "Internet Time" is at this point cliché, but the fact remains that the Internet moves faster than the WL Wave calendar seems to. Software + Services may be workable, but services need to have much faster release cycles than do conventional Microsoft software products. This is especially important if Windows Phone 7 is to succeed, as it will have significant dependencies on the WL online infrastructure.

In general, Microsoft needs to heed the messaging embedded in its own brands: Redmond's online strategy needs to be active and alive. It can't rest passively on its laurels and allow its momentum to die down.

Posted on 09/07/20102 comments


Microsoft's WinPhone RIM Shot

Long ago, in the mid and late-90s, the mobile device market was a bit different from today's. Palm led the PDA category, with monochrome devices that operated offline, until the Palm VII and its ultra-slow Internet service came out. The Palm VII was all the rage amongst early-adopters... I even bought the erstwhile publisher of Visual Studio Magazine's predecessor one and shipped it to him, because they were available in New York, but not in the Bay Area, where he was.

Then a Canadian company called Research In Motion came out with the Blackberry. It was also monochrome, and its form factor was that of an alpha pager. It was not a phone. But, with proper configuration, it could get your email over the air, in real-time, sometimes even before the message showed up in Outlook. And it had a wonderful QWERTY keyboard, that somehow made thumb-typing feasible. It could also sync your calendar and contacts over a USB cable, just like the Palm PDAs. I had one and it was pretty cool. Click here for a picture of that model.

To counter Palm, Microsoft came out with their PocketPC platform, appearing first on Compaq's iPaq device. A color screen, a workable on-screen keyboard (versus Palm's "Graffiti" stylus gesture input) and a Windows-derived software platform made it a compelling product. And with WiFi options, the thing count be nicely Internet connected, at reasonable speeds.

When Pocket PC morphed into "PocketPC, Phone Edition," the PDA platform became the first version of Windows Mobile, the one people now love to hate. Some said WinMo devices were just little PCs that could make phone calls, but when Phone Edition came out, that was literally true.

By this time BlackBerry units had also grown into phones, and Redmond's competitive sights slowly shifted away from Palm in Silicon Valley up north to RIM in Canada. Microsoft knew that RIM had two things they were missing: push email and physical keyboards. But those two things could be crafted by Microsoft and its OEMs, respectively, and given that a majority of RIM devices were in any case syncing against Microsoft's own Exchange Server, that meant Microsoft could provide the entire solution.

Microsoft was able to build its own Over-The-Air (OTA) sync technology, to which it applied its usual nomenclature savvy, christening it Exchange Sync. They then partnered with various handset OEMs, ironically starting with Palm and its 700w unit, to produce WinMo phones that featured the technology. Other phones followed, including the Q from Motorola and various units from HTC and Samsung.

This was (and is) a really competitive offering, but Redmond, with its business model, became its own worst enemy. The first problem was the then-current versions of Exchange and Windows Mobile did not ship with support for Exchange Sync. Exchange admins could install it though, without too much hassle. On the handset side, certain OEMs shipped their first units without the Exchange Sync client, promising an in-store flash ROM update to add it later on. Between the server and client, you had to be really determined to get Exchange Sync to work, and that was a pity.

Eventually, the releases of Exchange 2007 and WinMo 6 came, and both had Exchange Sync support built in, making provisioning much simpler and, finally, delivering a push email platform that avoided the expense of BlackBerry's Enterprise Server (BES) product. Sync fidelity was really good too, eventually allowing users not just to accept appointments, but to check for conflicts before doing so. Microsoft's ducks were finally in a proverbial row. And Redmond was ready to beat RIM and own the phone space.

And then, as if from nowhere, the iPhone came out. The holy grail for mobility shifted from keyboard and OTA push/sync to UI elegance. The first iPhone wasn't much for push email, but the second one was. In an ironic twist of fate, Apple added its own (licensed) support for Exchange Sync and, while not as good as WinMo's implementation (even now), it was good enough for many. Add to that the innovation of the AppStore, and Microsoft's ducks moved out of row formation and went every which way. Then Android came out and made the competition even worse; Google too has licensed Exchange Sync in order to make its mobile platform business-friendly.

Exchange Sync was important, and it still is. It remains the only communication technology that provides a mainstream alternative to BlackBerry (solutions like those from Good provide alternatives too, but they're just not mainstream). Apple and Android have Exchange Sync (and GMail even implements it on the server), but their implementations are less complete than Microsoft's. That can become a vulnerability if players like RIM and Microsoft can achieve something like parity on the touch-screen and user interface side.

RIM has tried to do this with BlackBerry OS 6. Reviews are mixed, and the company may be headed to a slow decline. With Windows Phone 7, Microsoft is also trying to keep the sync fidelity and pair it with a great consumer-acceptable UI experience.

RIM tried to revamp their OS. Microsoft decided to build a completely new one. RIM's approach seems like it might not have worked, and I actually think Microsoft's looks pretty good. After spending some more time with a WP7 phone today, I believe that even more.

And because of all this, although Microsoft is not marketing WP7 to the RIM customer demographic, I think that demographic is where it's going to get significant market share. RIM's customers are more churn-prone right now than are Apple's or Google's. And they need the quality Exchange Sync experience that only Microsoft seems willing to implement. They want fun apps, and they want to spend more of their phone time using them. But they need what they do with their phones today to keep working. They may not talk about it, or lust after it, but they need it. If it were gone, they'd be outraged. And that means, if they jump ship from RIM, they're going to need WP7.

This may sound boring, or anti-climactic. It may be tempting to dismiss it as "one dying dinosaur benefitting from another that is dying more quickly." But I think that misses the key point. Microsoft has focused on messaging for a long time. Exchange Sync made for a really good client play and the licensing of Exchange Sync to Apple and Google has helped Exchange become an even more entrenched standard for corporate email and groupware. Now a new Microsoft mobile device, with consumer credibility, may show how important the message/sync focus was. If this works, then Microsoft can focus on Android and iOS afterwards. And we'll see if the RIM-ex-pat momentum helps.

Posted on 08/31/20100 comments


LightSwitch Extensibility: It Ain't Just Hype

This past Wednesday, Beta 1 of Visual Studio LightSwitch (VSLS) was be made available to MSDN Subscribers. On Monday, it will be made available to the general public, at http://www.msdn.com/lightswitch. Even in advance of Monday, that site is already making useful content available. Specifically, a Channel 9 video called "Visual Studio LightSwitch - Beyond The Basics" is well worth the viewing time. In it, Beth Massi (Program Manager on the Visual Studio Community Team) interviews Joe Binder (a Program Manager on the LightSwitch team) and the conversation is a revealing one.

The two start off with what is emerging as the standard demo of VSLS: creation of a simple SQL Server database, with hierarchical relationships between tables, and some attractive screens with which to view, enter and maintain the data. VSLS is a new product, and Massi and Binder have to start with this demo.

But they then go past that simple scenario and bear out, in a practical demo, what Redmond folks like Dave Mendlen and Jason Zander have been saying for the last three weeks: enterprise developers can extend the standard functionality delivered by VSLS. As it turns out, Mendlen and Zander haven't just been nursing their talking points... if anything, they've been understating VSLS' virtues.

Joe Binder showed how VSLS extensibility works. He did so in a matter of fact way: he simply built a Silverlight control, and then used it in his LightSwitch app. He then built a RIA Service, plugged it into the VSLS project, and almost instantly built a screen on top of it. The Silverlight control was built in a standard Silverlight project, and the RIA service was built in its own standard project type as well. The only "twist' was that the Silverlight code could reference objects in the VSLS project and bind to one of its collections automatically.

What we learn from this video is that (1) LightSwitch projects can be extended in a serious way; (2) instead of building a bunch of new interfaces and special objects, VSLS extensibility is done with standard .NET technologies; and (3) that synergy between a new framework and standard, existing technologies is additively augmented with (and not replaced by) VSLS APIs. VSLS pros can do what they do while teaming with .NET enterprise devs doing what they do. That's low on disruption and high on added value. And beyond that, each one can learn a bit more about the other's discipline and make the result richer still.

I think this is how software should work. I think developers should be productive quickly and then have the opportunity to learn more and do even better. In other words, the skill levels should be Good and Better, rather than Bad and Good. LightSwitch makes that possible. Which means, despite fears out there which are utterly to the contrary, LightSwitch helps .NET, and it helps .NET developers.

The team behind LightSwitch derives from the teams that built many of the Visual Studio data tools and data binding technologies, as well as from Visual Basic itself. They're wonderfully pragmatic, if you ask me, and they fought hard to get this product out there. Lots of people, including folks at Microsoft itself, were skeptical of this product, and these guys got it done.

Version 1 won't be perfect. Version 1 is never perfect. If things go well, Version 1 proves a point, and does it well enough for people to make a switch (as it were) and use the product in their work. I hope things go well. LightSwitch needs to succeed and so do the people who need it.

Posted on 08/23/20105 comments


Microsoft's New Tools: Harmony or Cacophony?

In this blog and in my column, I've written a lot lately about new technologies from Microsoft that seek to make software development easier. Technologies like ASP.NET Web Pages, Razor and WebMatrix, Access Web Databases and Visual Studio LightSwitch. Each of these technologies, I believe, is bringing much needed accessibility to programming on the Microsoft platform.

I've also written about Windows Phone 7 which, despite extreme skepticism in the press and analyst communities, has the potential to be an excellent SmartPhone platform. And I've explored rather deeply HTML5, a technology that I believe poses an existential threat to Windows and to Microsoft itself, if Redmond's inertia of the last several years persists.

As I consider all of these technologies, something emerges that, with hindsight, is frightfully obvious: they need to coalesce, unify and harmonize. LightSwitch, which produces Silverlight forms-over-data applications, needs to target Windows Phone 7. Access Web Databases, which deploy as forms-over-data SharePoint applications, should perhaps have some conformity with LightSwitch, and vice-versa.

LightSwitch targets SQL Server Express by default. WebMatrix targets SQL Server Compact. Access Web databases target SharePoint lists and SQL Server Reporting Services. In other words, each of these exciting new tools targets SQL Server in some way (SharePoint lists are stored in SQL Server tables), but none of them targets the same edition of the product. I guess that's OK for the first versions of each of these tools, but I hope these anomalies are addressed in v2 releases. Microsoft likes to talk about impedance mismatches in data access technologies, and I think they've created a massive one of their own.

What about HTML5? Its threat could be blunted if Microsoft confronted it head-on. The version of Internet Explorer on Windows Phone 7 should be HTML5-compatible. LightSwitch v2 should target HTML5 as an alternate rendering target, which would enable LightSwitch apps to run on devices other than those running Microsoft operating systems, or the Mac OS (on Intel-based Macs). I wouldn't mind seeing SharePoint get more HTML5 savvy itself. It would enhance SharePoint's richness, in every single browser, including those that run on mobile devices.

To me, the biggest downside of HTML5 is the relative dearth of good developer tools for it, and the JavaScript heaviness it can bring about. But I would think that the HTML helpers in Razor and ASP.NET Server Pages could be a huge help there. Is Microsoft working on HTML5 Razor helpers now? If not, why not? And WebMatrix aside, it should add good IDE tooling for HTML5 in the full Visual Studio product.

Microsoft's got a lot of good answers to a great number of important software development questions. Now it just needs to make those answers coordinated and consistent. If it can really integrate these tools, then it should. Divided, some or all of these tools will fall. United, they might stand. They could even soar.

Posted on 08/13/20102 comments


Microsoft LightSwitch Defends Productivity

At VSLive today, I had the pleasure of introducing Microsoft Corporate VP Jason Zander. And he had the pleasure of introducing Visual Studio LightSwitch. Pleasure is a theme here, because the product, to me at least, looks great.

LightSwitch is a .NET based environment, hosted in Visual Studio, that allows developers to build business apps. Quickly. It harkens back, with pride, to tools of old, like VB6 and FoxPro, that made data, and data maintenance UIs, first class citizens. These tools also treated line-of-business developers as VIPs, not as the great unwashed.

LightSwitch builds Silverlight applications. They can run locally (in or out of the browser) and they can also run on Windows Azure. They can work with any database, but the development environment makes it very easy to create SQL Server databases, and can then deploy them to SQL Azure. The stock UIs look very Microsoft Office-like, but third parties can build alternative skins/themes that plug right into the environment. Infragistics already has a prototype. Microsoft showed it on stage today. And it did look really nice.

Data validations are built in. Search is built in. Business data types (rather than simple database or .NET data types) are built in. LightSwitch takes away the burden of creating a bunch of plumbing for corporate apps. Plumbing that you either have to write every time, or else use some framework that, by definition, won’t be very standard.

Tools in the 1990s did this too. Then the 2000s came and many of those tools largely went away. Now one has come back, and it targets the modern Microsoft stack, including Silverlight and Azure and the Entity Framework and WCF RIA Services. With considerably less working in the weeds to use these technologies than has been required until now. And, yes, LightSwitch lets you write .NET code when you need to.

I watched the tweets fly by during the keynote. Many expressed curiosity and excitement. Others expressed dismay. Dismay that “lesser” developers will have access to the modern stack. Dismay that they’ll build the apps quickly. And dismay that Microsoft wants to enable them. The dismay was often uttered under the cover of concern for stability, scalability and maintainability.

To the dismayed, I must say: get over it, and stop worrying. \There’s room for productivity developers. There’s room for enterprise developers. They don’t have to be at odds. This is not a zero sum game.

We need productivity programmers to be accommodated on the Microsoft stack. If they are not, they will go to other stacks. In fact, they already have. We have to try and get them back. They create opportunities for enterprise devs, and they create opportunities for their customers. I hope LightSwitch appeals to them. I hope it brings them back to the Microsoft ecosystem. I don’t know if it will, but even if it doesn’t, that doesn’t make it a bad idea. Celebrating difficulty and demonizing productive ease? To me, that’s the bad idea.

Posted on 08/03/201011 comments


Windows Phone 7, and the Court of Pundit Opinion

On Thursday, a scathingly bad review of Windows Phone 7 (WP7) was published by InfoWorld. I had considered writing a post to refute some of its points, but Paul Thurrott did just that, and did it masterfully. There's little value that I can add to his post, other than to link it and suggest that you read it.

Meanwhile, Sunday and Monday, much more fair reviews were posted at CNET, ZDNet, Gizmodo, Engadget and MobileCrunch. All of these reviews were based on actual hands-on experience with a prototype Samsung device called "Taylor;" the InfoWorld post was based on the author's apparently unenjoyable experience at a product demo.

I'll let you read the reviews on your own and won't provide a CliffsNotes style redux of them here. What I will do though, is try and present some of the consensus findings, and how I think those findings bode for the success of the WP7 platform. Here goes:

  • 1. The touch screen is accurate and fast. This is huge...my biggest concern about WP7 was that in the early demos, the combination of the hardware and software seemingly produced a substandard touch experience. If you look carefully at those early demos, you will see flicks and swipes that are either ignored, or which produce responses on an unacceptably delayed basis. What I said then is that Microsoft and its OEMs needed to fix this and make it flawless, otherwise it would be a deal-breaker. Seems like this gap has been closed, at least on the Samsung hardware that the reviewers used in their evaluations.
  • 2. The keyboard is accurate and fast too. A couple of the reviewers were emphatic in their enthusiasm over the keyboard. This is a big deal too, especially as a high-value candidate WP7 customer group is current BlackBerry customers, and they are used to physical keyboards. This really looks like an area where Microsoft can tie with Apple and win against Android.

  • 3. The highly text-oriented Metro interface is very appealing to certain users, and others find it disorienting. This is about what I expected, and even a bit better for Microsoft than I might have predicted. Microsoft decided -- wisely, in my opinion -- to craft a smartphone user interface that was not derivative of the iPhone's or Android's. I applaud this, but the danger in that is that Microsoft is breaking with a standard, and many people will see that effort as folly, and its work product as unusable. The outcome seems to be that InfoWorld hates it, a couple of the other reviewers were uncomfortable with it, and the remainder were pretty positive. Even CNET (one of the doubters) sees the validity in doing something different. Together, these reviews provide a genuine endorsement of Microsoft's UI strategy gamble, even if not a vote specifically for Metro, in all cases.

  • 4. Exchange integration and email in general seem very well implemented. Once again, this will appeal to the BlackBerry crowd. Office integration seems more optimized for viewing documents than for editing them. That’s a disappointment, to be sure. But it’s no worse than the other platforms.

  • 5. The camera is really good, highly accessible, and fast. This could be an unexpectedly important advantage for WP7. Megapixels aside, the state of the art in mobile phone cameras still sucks wind. If Microsoft breaks this precedent and people hear about it, then it could be a nice driver of new handset sales for the platform.

  • 6. The Web browser, though not best in class, seems very good. This will surprise people who assume that Microsoft's lack of a WebKit-based browser means WP7 can't be functional for Web browsing. Opinions seem mixed regarding lack of HTML5 support. My take: this will need to come fairly quickly, but is likely not to be crucial at launch. My Motorola Droid has a WebKit browser with decent HTML5 support. But I think the only place I've put it to work was on the HTML5 test and demo sites I hit with it, out of curiosity.

  • 7. Everyone thinks the lack of cut and paste is unfathomably sucky. And they're right; it is. I think there's a very high probability that this capability will come in an over-the-air OS update within months of launch, and maybe sooner. In fact, I think there's a 30% chance that Microsoft will surprise us and have cut and paste ready for launch itself. Most reviewers bemoan the lack of multitasking too. I think this is less important – I think most iPad owners would agree, or at least they will up until the iOS4 release for their devices. That’s sort of my point: you can live without multi-tasking, until you have it, and then it’s a non-issue.

  • 8. Facebook integration is elegant and simple. It "lights up" exciting and impressive functionality on the phone. But it's not configurable enough and is unwieldy for people with a large number of Facebook friends. Good enough for v1.0, but probably not for v1.1, let alone v2.0.

  • 9. Twitter integration, other than through Windows Live, is conspicuously absent. Either Microsoft needs to add this, or a third party Twitter app, hopefully from Seesmic, needs to be available immediately and its integration with WP7's hubs and other features must be exemplary. If neither a native nor good 3rd-party app is available at launch or very soon thereafter, it could make WP7 a laughing stock. That could happen anyway, of course, but the lack of Twitter integration could be a laughter accelerant.

  • 10. UI inconsistencies in WP7 exist, especially around search and hidden "long taps" and could prove fatal. Or not. On the one hand, WP7 needs to be perfect, and these apparent issues make it fail the perfection test. That, in turn, could prevent WP7 from getting over the incumbency lock that Apple and Android have on the market. On the other hand, neither of those platforms is perfect either, and they certainly were not perfect at launch. So maybe people will cut WP7 some slack, given the high points already discussed here.

  • 11. Overall, WP7 will make Microsoft a contender in the mobile arena again. How long it can maintain that contention, and whether it can convert it to a leadership position is anyone's guess. But it is trying, it is getting traction, and it has the will to fight. Given the lowered expectations just about everyone has of Microsoft in this market, the mere fighting spirit and encouraging interim achievements it has delivered may catch people's attention. Heck, maybe that's why the crash and burn of Kin was so public and extreme.

WP7's introduction and market positioning will be seminal for Microsoft, to the upside, or to the downside. A significant success could restore morale amongst Microsoft's employees, partners and customers. If it merely establishes a toehold, that could be very positive too -- just look at Bing for evidence of this. But if WP7 flops, it could cause irreparable damage to a company that is already diminished in the mobile and consumer space, a space which is becoming ever more influential on the enterprise arena that is Microsoft’s bread and butter.

A WP7 flop could come even if Microsoft does everything right with the product. Many people have true disdain for Microsoft, and at least some of these people need to be won over. That's hard when the hatred runs so deep and the loyalty to other players seems to impenetrable.

To win this one, Microsoft needs to do what it did to make Word overcome WordPerfect, Excel beat Lotus 1-2-3, Exchange overcome Notes, and Live Messenger overcome AIM, all combined with the chutzpah, naïveté and finesse used to launch Bing and make everyone forget about Live Search. Given all but the Bing victory occurred long ago, when Microsoft was much more on its game, this victory is nearly impossible. But if you bet on Microsoft, you'll certainly get good odds.

You might get a really good phone too. And isn’t that the authentic goal?

Posted on 07/20/20103 comments


WebMatrix, Razor and a Return to Simplicity

This week, Scott Guthrie, Corporate Vice President at Microsoft's Developer Division, announced, via blog post, the early Beta release of a new tool called WebMatrix. WebMatrix is a free developer tool that enables Web development geared toward what I might call Markup-and-Script developers (more on that in a minute). And although WebMatrix draws upon technologies already, or soon to be, present in the fuller ASP.NET Web development platform and the Visual Studio integrated development environment (IDE), it is a radical departure from what those technologies have evolved into. Some review of Microsoft developer tool history might bring this into perspective.

Simple Beginnings
In the early and mid 90's, Microsoft's developer tools were pretty simple and straightforward. For Windows development, Microsoft had its Visual Basic (VB) product, and for Web development, it had something called Visual InterDev. For hardcore developers there was Visual C++, and for adherents to the acquired FoxPro product (now called Visual FoxPro, of course) there was that too.

The four products were sold together as a single entity called Visual Studio, but that name was really a bundle and umbrella brand for the four constituent products. Most Visual Studio customers used VB and InterDev for their work. VB featured an easy drag-and-drop design environment for building Windows desktop applications: drop controls on the form, set some properties, add a little code, and you could have a functional application. Visual InterDev provided an IDE for developing Active Server Pages (ASP) applications, which were simple text files consisting of HTML and Visual Basic code (actually a scripting version of VB, called VBScript). The VBScript was embedded within the HTML markup within <% and %> tokens so that the ASP engine on the Web server would know to parse it and send it to the Active Scripting engine. The files ended in an .asp extension so that the ASP engine would be invoked in the first place.

None of this was especially difficult, and yet it was impressively powerful. With VB, and ASP/Visual InterDev, Microsoft provided a way for clever, logical thinkers to be productive programmers in a short amount of time, and to use the same programming language expertise for both desktop and Web applications.

It was the best of times; it was the worst of times. Microsoft made programmers productive, but the low barrier to entry meant that lots of VB and ASP applications were written by bad programmers, and it gave the platform a bad name. Meanwhile, Java and its Java 2 Enterprise Edition (J2EE) flavor were eating VB and ASP for breakfast. J2EE was more complex and fragmented, but also more robust, scalable and, to be honest, more appealing to a higher caliber of developer.

Redmond's Revenge
Microsoft's response was to create the .NET Framework. Version 7 of Visual Studio was the first version of Visual Studio .NET. It provided a single IDE for desktop development and Web development, which could be done in a new version of VB (called VB .NET), or in a new langauge called C#, which bore an uncanny resemblance to Java. C++ could be used inside this IDE as well, and so could Microsoft's own licensed version of Java, called J#.

This version of Visual Studio and its Web technology, now called ASP.NET, extended the forms metaphor to Web development, such that the old "VB" and "ASP" were now called WinForms and WebForms, and they worked in a very similar manner. A (surprisingly) little known fact is that ASP.NET applications could still be developed using the old <%... %> syntax in the markup, without the need for forms and controls, but there was no encouragement from anyone to write ASP.NET code as if it were ASP.

The new IDE was more complex than any of the old ones, but in unifying them, it added simplicity too. A universal forms metaphor and a unified IDE, with the added rigor of the .NET Framework, and fully object-oriented programming made .NET very competitive with J2EE. Also, the programming was just enough harder to filter out many of the less capable developers who were on the Microsoft platform before. Microsoft made a big bet, and it won.

The Plot Thickens... And So Does the Platform
But Microsoft lost too. In political terms, it abandoned its base. And I think it did so based on a notion of false choice: it thought it had to cater to enterprise developers or productivity programmers, but that it couldn't do both.

And then it got worse: after the 2005 edition of Visual Studio and version 2.0 of the .NET Framework came out, Microsoft added a trio of technologies: the Windows Presentation Foundation (WPF), Windows Communication Foundation (WCF) and Windows Workflow Foundation (WF). Originally these three technologies were planned to be part of what became Windows Vista, and were to be known collectively as WinFX. When they shipped, however, Microsoft decided to dissociate them from Vista and allow them to run on XP as well. Since they were really extensions to .NET, Microsoft rebranded the collection as .NET 3.0.

And this is where things started to get really complex. WCF and WF were not, and are not, for the faint of heart. WPF introduced a completely new way to create desktop applications. And while it added a slew of new capabilities, its designer for Visual Studio removed most of the productivity from its WinForms counterpart. These technologies have since been updated and have been joined by Silverlight (a relative of WPF, remade for Rich Internet Application use), ASP.NET MVC (which does away with the WebForms metaphor, but does not return us to the single-file comingled code + markup model), Language Integrated Query (LINQ), the Entity Framework (a data access model which sits atop, but effectively replaces, the native data access core, known as ADO.NET) and an array of application lifecycle management features within the Visual Studio IDE itself.

This is neat stuff. This ups the challenge to Java. It accommodates development of very large applications, built by big teams, distributed across the world. All of that is good. Much of it is crucial and necessary. But none of it helps that original constituency of developers who want a highly productive environment in which they can build entire applications (albeit smaller ones), quickly, easily, and largely by themselves. And those folks have been willing to be neglected for only so long.

Voting with Feet
Many of those productivity programmers have left the Microsoft platform, and many newer, younger programmers who also fit that profile, have steered clear of .NET and Microsoft completely, for this and a variety of other reasons. A lot of them have moved to languages like PHP.

If you look at PHP, you'll see it bears a strong resemblance to the old ASP: code comingled with markup, contained in blocks offset with <?php and ?>, inside files with a .php extension. There's no huge framework, nothing really like WCF and WF, and most PHP developers use very light tools for editing their code -- thick IDEs exist, but aren't so much the norm. PHP has a huge and enthusiastic community around it too. And while it may not be the right environment for those huge enterprise apps, it's good enough: Yahoo and Facebook run it, in fact.

So we're left with a situation where Microsoft is losing in market share, passion and enthusiasm to a development environment that works quite similarly to something Microsoft had 15 years ago. Yes, there are important differences: PHP runs on Linux as well as Windows. PHP is open source. Its syntax looks much more like C or JavaScript than it does Visual Basic. But the fact remains it has a simplicity and short path to productivity that intrigues developers and empowers them, and that's exactly what Microsoft knowingly and willfully jettisoned

Microsoft could always promote the fact that code + markup still works with ASP.NET. You can still use <%... %> syntax... and store everything in single files with an .aspx extension that you can then just push up to a Web server. You can edit these files pretty easily in Visual Studio. If you have the discipline to ignore all the other stuff in ASP.NET and the .NET Framework and all those menu options and toolbars and dockable windows in Visual Studio, you'll be fine. But advising abstinence and calm is no way to win over an entire population of developers that wants to spread out in territory that is friendly and navigable to them

Back to Basics
So instead of providing guidance around using a subset of ASP.NET Web Forms and a subset of Visual Studio, or just bringing back the old tools, Microsoft has done something far better. Through the introduction of a technology code-named Razor and its use in a new code + markup environment called ASP.NET Web Pages (not Forms) and provision of the new, highly streamlined WebMatrix IDE, Microsoft is beckoning the productivity programmers back, in a credible way, without condescension.

Now instead of starting your code with <%, you can use a simple @ sign for embedded expressions (and you don't need to end the expression with anything!) or use @{ and } for full-on code blocks. You put everything into files with a .cshtml extension (you can use .vbhtml too, with the inline code in VB.NET but the Razor code block syntax differs slightly). Razor also provides so-called HTML Helpers that make short work out of complex tasks. Want a scrolling window with tweets from me? Just embed this code in a page:

@Twitter.Profile("andrewbrust")

There's another helper just like that for Facebook, and a collection of others for creating data-driven user interfaces, sharing links on social networking sites and performing Web Analytics tasks.

WebMatrix also comes with a workstation-hostable version of Microsoft's Web server (Internet Information Server, or IIS) called IIS Developer Express. And it comes with a small, file-based database engine called SQL Server Compact, which is entering its 4th version, but only its first version optimized for ASP.NET. SQL Server Compact databases, and SQL Server Compact itself, can be easily deployed to any Windows Web server over any file copying protocol, including FTP. And WebMatrix can do that for you, with just a couple of clicks. It can even help you find a hoster and provision an account. There's also built-in starter features for creating and editing data, and for performing SEO analysis on your pages.

Web Matrix isn't exclusive to ASP.NET and SQL Server by the way. It also lets you edit and create applications using PHP and MySQL! That's a HUGE step for Microsoft, especially with regard to the database.

Gimmick, Experiment or New Leaf?
WebMatrix isn't perfect, certainly. And it's streamlining sometimes borders on plain old bare-bones. There's no IntelliSense (pop-up syntax completion), no rendered view of your Web Pages (you have to run the pages in a browser for that) and not much documentation that I can find, either on the tool itself or on Razor and the HTML helpers it includes.

Also, this is not the first product Microsoft has had called WebMatrix. An earlier product with the same name, back in the early days of .NET, which provided a simplified IDE for creating ASP.NET WebForms, was put on offer, also for free. That product gave rise to the Visual Studio "Express" Editions... but the original Web Matrix project died.

Will its successor suffer a similar fate? Is this just a freebie tool that Microsoft will obsess on for a while and then let languish? Is it just a cynical attempt at converting PHP developers over to the full-blown ASP.NET stack? It's hard to say, and Microsoft needs to make a real commitment to this WebMatrix if it wants developers to invest in it.

But it's a great start, and it's the first thing I have seen in a while from Microsoft that makes programming powerful and fun at the same time. I hope it's a precedent, and not mere anomaly.

Posted on 07/12/20108 comments


Kin Post-Mortem, Top-10 Style

On Wednesday, Microsoft announced that their short-lived social networking-oriented phone, Kin, was being discontinued. I’m glad. In a post I wrote over a month ago, I implored Steve Ballmer to kill the product. I didn’t just do that because Kin 1 and 2 received terrible reviews; I had other reasons to distrust this product’s efficacy.

The Kin team has been led by Roz Ho, whose title has been Corporate Vice President, Premium Mobile Experiences. During the development cycle for Kin, a.k.a. Project "Pink," there was some reporting that Ms. Ho led the team badly. The team was the successor to the crew at Danger, the company that built the T-Mobile Sidekick, and which Microsoft acquired in 2008. The negative reporting on Ho included the suggestion that her leadership made for morale so low that most of the original Danger team quit their jobs.

Cnet’s Ina Fried broke the Kin killed story Wednesday. In her piece we learned that the Kin team would be merged into the Windows Phone 7 group and that:

"Roz Ho, the Microsoft executive who lead the unit that developed the Kin will oversee the transition of the team and then move to an as-yet-determined role at the company, according to a source."

None of this is surprising. Given the product’s history, it was clear to me that Microsoft would have to kill Kin. But Windows Phone 7, which still looks promising, got under development quite a while back. When that team was organized, the legacy Windows Mobile team was disbanded. Why didn’t Roz Ho get the heave ho, too? (Ahem!) With WP7 on track and looking good, why on earth did Microsoft bring Kin to market? Here are my top 10 reasons, some more serious than others (drum roll, please, Paul):

10. Taking down a Corporate VP wasn’t politically feasible. Kin had to be brought to market, and had to fail, in order to topple Ho from her position and consolidate power in the WP7 team.

9. The investment in Kin, both in terms of the Danger acquisition and subsequent development was really big. Ballmer figured he had to give it the old college try…and then bail quickly if indeed the phones were duds.

8. Verizon wanted their own Sidekick-like device (not wanting to cede that part of the market to T-Mobile) and implored Microsoft to persevere with Kin’s development.

7. Microsoft knew the Kin would fail, but they wanted to use it as a trial balloon for Kin Studio, the companion cloud service that replicates most data and content stored on the phone. This would help Microsoft determine if the Studio concept should be used with Windows Phone 7 when it launches later this year.

6. When the Kin team finished its work, it was nearing the end of Microsoft’s July 1 fiscal year. They had leftover TV ad budget and they had to spend it on something.

5. Microsoft got the kin.com three-letter domain name and they couldn’t let it go to waste.

4. Microsoft really didn’t want Sharp to be a Windows Phone OEM. They didn’t have the heart to tell them though. This was their passive-aggressive way of getting Sharp to back off.

3. Microsoft was angry at Engadget for their negative review of Kin. So they killed it and gave Gizmodo the scoop.

2. The announcement yesterday was an elaborate April Fool’s joke. But its ship date was delayed until the end of the quarter. and…

1. The whole thing was a dare to Verizon from Apple. Jobs said if they carried the Kin in earnest for 2 months, he’d give them the iPhone in January. And Verizon really wanted the iPhone.

I once worked for a guy who told me sarcasm was the lowest form of wit. So be it. I’m done now.

Posted on 07/02/20101 comments


New York City Gets Data Happy

This past Monday, June 21st, the New York City Council Committee on Technology in Government held a hearing on its proposed legislation, known as Introduction 029-2010, that would require all City agencies to publish their data online, in "raw" form. The data would be available to private citizens who wished to analyze it, hobbyist developers who wished to work with it, and commercial entities looking to utilize it internally or create products that use and add value to it.

Such initiatives have already taken root in other jurisdictions, including the U.S. Federal Government. Its open data portal, at www.data.gov, serves as a very good example to state and local governments that wish to implement the same sort of good government transparency through technology.

At first blush, the legislation would appear difficult for anyone to oppose. Donn Morrill, chairman of the New York Technology Council (NYTECH) , eloquently expressed this point of view in his testimony at the hearing:

"This should not be a contentious bill. None of you will lose a vote. None of you will lose an endorsement. None of you will lose a dollar in financing by supporting this bill. What you will gain is recognition from the community that your affirmative vote will open doors for enterprising companies to develop new and exciting ways to experience New York City."

In my opinion, Morrill’s quite right; enactment of the legislation should be a "no brainer." The fact remains, however, that there has been resistance to it. A year ago I was present, and testified, at another City Council hearing on last year’s version of the same legislation. At that meeting representatives from the Mayor’s Office, in their own testimony, discussed the then recently announced NYC Big Apps competition and the data feeds that were published to facilitate it. They proclaimed the Mayor’s "customer-centric" position that only select data should be published, because only select data would be of interest to City residents.

The Mayor’s thinking, at the time, was that investment of City resources in producing feeds of all non-privacy-protected City data would be impractical, given that only a relatively small subset of it would be used. Committee Chairperson Gale Brewer disagreed, explaining that determining which data was valuable prior to its publication was virtually impossible. Andrew Hoppin, the New York State Senate’s CIO (follow him on Twitter at @ahoppin) made a similar point in his testimony this week, appealing to the City to "Resist the temptation to adjudicate what [data] is of value and what is not of value."

I agree, and said so in my own testimony at this week’s hearing. I think the whole point of publishing government data is that seemingly mundane data can form the raw material of extremely useful information, be it related to health, economics, commerce or even potholes.

The good news is that at this year’s hearing, the Administration’s attitude seems to have changed. The recently appointed Commissioner of the City’s Department of Information Technology and Telecommunications (DoITT), Carole Post, essentially the City’s CIO, expressed her agreement in principle with the legislation’s aim of making all agency data available. Where Post took exception to the legislation is in the cost and effort feasibility of making such a wide ranging set of data available in a relatively short timeframe. This is a tough call. As I said in one of my live tweets during the hearing, the "ask" of DoITT is big and scary. But if they express that, it looks like they're stonewalling. For what it’s worth, I think Commissioner Post is not stonewalling. I think she’s dedicated to this effort, and wants to avoid over promising and under-delivering.

Getting the data out can be difficult, both for reasons of bureaucracy and technology. If the data to be published is managed by a legacy mainframe application, getting it out there in digestible XML or CSV form may not be so easy. And even if it is, publishing static data is only the first step. Eventually the data should have an API (application programming interface) around it so that developers can query it interactively and, in some cases, create/submit data as well. Think about it: we don’t just want to get a of list crimes that took place. We want to be able to query that list by neighborhood or police precinct, median income level of the area, severity of the crime, and determine also if the rate of crime in that narrowed category is increasing or decreasing. Insurance companies, real estate agents, and makers of security products may like to know likewise. And the City itself should want to know too, so resources in the next fiscal year can be allocated appropriately.

Beyond such analytical inquiries, there should also be an API for reporting crimes (which would require creation of data, not consumption of it) too. This could allow citizens to report crime, in real time, from their mobile phones, with the tap of a button in an app. The GPS in the phone could alert authorities to the precise location of the incident, and the phone's camera could even submit a photo. Maybe such technology could address the "bystander effect" allegedly exhibited in the infamous Kitty Genovese stabbing case of the 1960s. Imagine if New York City government used technology to obsolesce a phenomenon made prominent in its own jurisdiction. Removing that blemish would be a proud moment.

I mentioned in my testimony that Microsoft's Open Government Data Initiative (OGDI) should be considered by the City as one platform for serving the City’s Open Data. OGDI is based on the Open Data Protocol (OData - itself based on numerous open Web standards) and Microsoft’s cloud platform, Windows Azure. OGDI is itself an Open Source starter kit that provides not just for the publication of data, but of a programming API and the ability both to read and write data.

Regardless of the protocol used, Open Data for this nation’s largest city is immensely important and it's very heartening to see the Council and the Administration in relative agreement on this point. Should the legislation be enacted, and implemented, the opportunities for entrepreneurs and the potential benefit to the public, to business and to the City itself will likely be big, exciting, and inspiration for municipalities across the world.

Posted on 06/24/20101 comments


Tech Influencers Take to Capitol Hill

Three days ago I participated in a special outreach campaign. Specifically, I was part of an effort to mentor various members of the U.S, Congress (in both the House and Senate) in issues concerning technology companies. I took part in a full day of meetings on Capitol Hill, organized by the Association for Competitive Technology (ACT), an organization with which I have been associated for more than 10 years and on whose board I now sit.

I met with many elected officials' staff, but also had meetings with members of Congress. I have participated in an ACT "fly-in" before but, even so, I was once again exhilarated with the experience of engaging members of Congress so directly.

The participating ACT membership split up into five groups, roughly defined along geographic lines, such that each group was matched with its own members' elected officials. All in all, the ACT membership met with the offices of more than 30 Representatives and Senators, from both major parties. We carried forth important messages about cloud computing, net neutrality, intellectual property, taxation of carried interest and its impact on funding of tech startups, and more.

The good news? The ACT delegation was respectfully received, and members of both parties seem very cognizant of the importance of small technology companies to the economy. Everyone listened to us attentively, many took careful notes, and several seemed interested in working with ACT in the future, in order to understand tech issues better.

The bad news? Many, though not all, members of the Congress, including those who have significant influence over legislation affecting the industry, remain ignorant of many aspects of technology. It's a bit frightening, to be honest, and as good as the fly-in was, it certainly didn't resolve the problem.

That problem will only be solved if and when our participatory democracy enjoys, well, greater participation from the tech industry. That's a tough order because, in my experience at least, most technology entrepreneurs tend to be cynical about government, and politics too. In fact, there seems to be an intractable paradox: those who need to educate elected officials most are those least likely to believe that they can. Given how busy techies are, and their corresponding need to triage their time, political activism often gets ruled out.

Where does this leave us? I am not sure. But I would encourage people to get involved, on a trial basis, and here's why: everyone who I have seen try, including those most skeptical, become excited, engaged and much more optimistic once they've been through the process. And the next such convert could be you.

ACT maintains an office in Brussels and lobbies the European Parliament, as well as the U.S. Congress. If you're a tech entrepreneur or executive in the US or the EU, consider joining ACT and getting involved. Participate in one fly-in. If it doesn't change your outlook, so be it. But I bet it will, and I bet you can make a concrete difference in laws that affect your business, and you.

Posted on 06/21/20103 comments


Tech Ed/BI Conference 2010: Signs of Recovery

I tried writing a post for this blog last night, while at the this year's Microsoft Tech Ed and Business Intelligence conferences in New Orleans. But I literally fell asleep while writing it. That's probably a sign that my readers might have done the same while reading it.

Why the writer's block? This was a very good show for me, but I think I was having trouble figuring out exactly why. Now that I'm on the flight home, I'm starting to piece it together.

One reason, for sure, was that I've spent years in both the developer and the BI worlds, and a show that combined the two was really enjoyable for me. Typically, the subject matter, the attendees, the Microsoft execs and managers, and even the social circles have been separate. This year's Tech Ed facilitated a fusion of each of these previously segregated groups.

That was good for me as a speaker; for example, I facilitated a Birds of a Feather session on PowerPivot (Microsoft's new self-service BI offering) that was well-attended, and by a large number of non-BI pros no less. The fusion was good for me as an attendee too, as Microsoft BI, in the form of a new Pivot Viewer control, made it into the Day 1 keynote, demoed by Microsoft's key BI champion, Amir Netz. And it was good for me socially, as I was able to meet with peers in both camps, and at one location.

Speaking of meeting with industry colleagues, I did a lot of that at this show. Probably for the first time ever, I carefully scheduled and conducted a series of meetings with friends and business acquaintances in the developer tools, data visualization, utilities, publishing and training areas of the Microsoft ecosystem. Beside the time efficiencies in conducting so many meetings, I discovered another benefit. I got a real handle on the tech industry's economic health.

The news here is good. First of all, 2010 has been a great year for just about everyone I spoke to. The mood is positive, energy is high, and people are working really hard. This is, of course, refreshing to see, and it's a huge relief. Add to that the fact that this year's Tech Ed was about 2.5 times larger in headcount than last year's (based on numbers from unofficial, but reliable, sources), and the economic prognosis seems excellent. But there's more to it than that.

Here's the thing: everyone I talked to seems to be working, and succeeding, at changing their business models to adapt to changes in the industry. Whether it's the Internet's impact on publishing and training, the increased importance of the developer audience in South Asia, the shift of affordable developer and business talent to unfamiliar locales abroad, or even lapses in Microsoft's performance in the market, partner companies aren't just rolling with the punches; they're welcoming the changes and working them to their advantage.

No one seemed downtrodden, or even fatigued. Even for businesses who have seen core revenue streams become commoditized, everyone seems to be changing their market strategy and winning. Even Microsoft, of whom I have been critical recently, showed signs of successful hard work and playbook change, in the maturing of their cloud strategy, their commitment to it and their excitement around it. And the embedded, managed, self-service BI strategy that Microsoft has been touting looks like it's already being embraced by customers, even though PowerPivot, and other new Microsoft BI products, were released only recently.

The collective optimism I have witnessed, and that I have felt, tells me good things about this industry and the economy. The stock market had huge mood swings during my stay, and that may yet subdue the industry recovery I have seen this week. Nonetheless, I am convinced that a strong foundation of hard work, innovative thinking and, if I may, true renaissance is underlying this industry's success.

That kind of strength will generate a strong recovery, I am certain, whether now or once we're past another round of choppy weather in the broader economy. The fundamentals are good.

Posted on 06/11/20102 comments


Subscribe on YouTube