Arlen Bankston is a lean six sigma master black belt and certified ScrumMaster trainer. In the following interview with StickyMinds editor Jonathan Vanian, Arlen discusses the rise of the Lean Startup movement, tools to capture customer feedback, and what constitutes good metrics.
Arlen Bankston is a lean six sigma master black belt, certified ScrumMaster trainer, and certified scrum product owner who has led agile and lean deployment and managed process improvement projects for clients such as Capital One, Neustar, and Freddie Mac. In the following interview with StickyMinds editor Jonathan Vanian, Bankston discusses the rise of the Lean Startup movement, tools to capture customer feedback, and what constitutes good metrics.
Jonathan Vanian: For those who may not be totally familiar, can you give a rundown of just how big the Lean Startup movement has grown to? Has the growth you seen in companies or organizations adopting these techniques been growing much more rapidly in recent years?
Arlen Bankston: The “Lean Startup” as such was coined by Eric Ries in 2011, and qualitatively speaking, its growth since then has seemed explosive. I went to the second Lean Startup conference, and there were a few hundred people expressing the same energy I saw at XP Universe 2002, one of the earliest “agile” conferences. Todd Park, the US CTO, was a key speaker, which gives you a sense of how the movement has certainly spread beyond its Silicon Valley roots.
JV: Can you give a rundown of some of the tools and techniques product owners are employing?
AB: Among the most popular are the various business model-planning tools, such as Trevor Owens’ Javelin and Ash Maurya’s Lean Canvas, which product owners employ to guide release roadmapping activities. Many of these tools can work in either analog or digital form, and their simplicity makes them easy to adopt. The other areas I’ll be covering include Market Fit Testing, Release Planning, Prototyping, Landing and Launching, Analytics and Testing and Customer Service.
JV: Can you explain how product visioning and experimental design can benefit from the proper tools and techniques?
AB: All business cases are based on assumptions, which are usually wildly optimistic; these tools can help keep us honest by forcing us to visualize, share, and explicitly test these assumptions. This hearkens back to an old concept, introduced years ago in the Harvard Business Review, called “discovery driven planning,” which sits at the heart of many agile methods. What I’ve found is that when product owners don’t do a good job of figuring out how to measure the specific risks inherent in their initial strategy, their decisions become subjective and arbitrary. Agile methods can make change cheap, but they don’t ensure smart decisions.
JV: What specific tools do you recommend for those looking to capture customer feedback early in the production cycle?
AB: In the very early stages, in-person interviews are undoubtedly one of the most effective methods. At first, you’re trying to discover whether your supposed early adopters are in fact as thrilled about solving the problem you’ve posited as you are, and once that’s established, you’re using low-fi prototyping methods to see how apropos your solution might be. Aside from the oft-touted “get out of the building” notion, there are also digital approaches like crafting simple landing pages with tools like UnBounce and WuFoo to gauge interest through beta signups, pre-orders, and the like.
JV: There are always experts debating what exactly constitutes good metrics. What are examples of good metrics companies can gather that will help them in project visioning?
AB: Different metrics are appropriate at different stages of a product’s lifecycle. For instance, early on, you’d like something that helps you gauge the size and nature of your target audience, like signing up to be notified when the product is released. A customer that provides one’s email address is clearly more qualified than one that just clicks on an ad, and you’re looking to establish that meaningful bar for yourself at each stage. A common approach for the long term is to establish your key use cases and measure how often customers successfully complete them over time.