The Shatzkin Files

This post invites you to help us shape the agenda for Digital Book World 2015.

It was five years ago this summer that David Nussbaum and Sara Domville of F+W Media took me out to lunch and said they thought the book business could have a more useful digital conference — one, in their words, that would give you things you could go back to the office and use — than the existing set of conclaves, led by Tools of Change, then provided. And they flattered me and provoked my imagination by saying “we think you’re the guy to program it”.

At the time, I was in a partnership with O’Reilly Media, the owners of Tools of Change, working on an initiative called “StartWithXML”. We had a conference in London coming up as part of our team effort that was only a few weeks away. I wasn’t looking for a way to compete with them.

But, when I thought about it, I realized that by changing the focus of our conference from “technology and publishing” (which was theirs) to “the business challenges created by technology for trade publishers”, we would be able to do something quite different than they had. Agents would be included, and, this being long before the agents were hiring people with digital publishing expertise to help their authors, they weren’t invited to be part of Tools of Change. I knew their voices were important when you talked about how the business of publishing would be affected by digital. And real challenges around resource deployment and marketing, which weren’t strictly-speaking about technology but which were top of mind for trade publishers, would make our agenda when we framed it this way as well.

They named the new conference Digital Book World.

This recommendation really just followed my own advice. I had been observing that book publishers needed to become more “vertical”, by which I meant “audience-specific”, in their thinking. Tools of Change was horizontal; it was about all publishing and technology. We’d focus Digital Book World on a particular segment of publishers and therefore be able to make it more meaningful for them.

Now we are planning our sixth Digital Book World conference for January, 2015. A lot has changed. Tools of Change shut down in 2013. Perhaps partially aided by the disappearance of its biggest competitor, Digital Book World has continued to grow, with more than 25 percent growth in 2014 over the year before.

But a big part of the distinction that guided us as we built DBW, the emphasis on trade publishing, is eroding in importance as the trade itself — which means the bookstores and libraries and the wholesalers that serve them — become less robust paths to the consumer. The challenges for an industry beginning to move from physical goods in stores to virtual goods online are different as the new paradigm becomes the dominant paradigm.

Except for self-published genre fiction (and perhaps even for publisher-issued genre fiction too), that paradigm shift hasn’t really happened yet, but the day when it will is in sight. At some future Digital Book World — not 2015, but maybe 2016 and almost certainly before 2020 — we will be looking at a “trade” book industry which does most of its business online, not through brick-and-mortar stores.

(In fact, the world has changed so much that one thing on my list to discuss is a DBW 2015 panel that would reconsider the whole StartwithXML premise. When we were thinking about this in 2009, we figured the biggest payoff from going through what could be a painful workflow change was that you’d be able to make ebooks of complex books much more efficiently. That’s probably still true, but the ebooks for complex books also haven’t sold very well and their future is a bit cloudy. Knowing that, how important was that change to make, really? We’ll ask some publishers who have gone through it and, depending on what reports we get, perhaps put it on the program for discussion in January.)

All of this not only means that what we have called trade publishers may be renamed, they will also find themselves with new channels to consumers and a new set of competitors. The prospective new landscape will get a great deal of attention from us next January and we are beginning to interact with players that wouldn’t really have belonged at DBW in 2010 or 2011 but who might be smack in the middle of our business by 2017 or 2018.

Who are they? They are educational publishers, both K-12 and college. They are newspapers, magazines, and advertising agencies. And they are digital-first publishers, coming out of web sites and other content creators and brands, who see the opportunity to reach audiences efficiently through a book business that no longer requires a big investment in printed inventory and an organization reaching thousands of small sales outlets for meaningful participation. And they are start-ups and technology companies too.

We are going to start this year by looking for the Venn diagram “overlap” between these new audiences and the trade publishing audience we’ve served for half a decade.

For newspapers, magazines, and advertising agencies, that means we’ll be looking for the players who have already found opportunity in the book publishing ecosystem. Although for all of them ebooks are really a highly complementary opportunity, it looks like newspapers have made that discovery more rapidly than the others. Newspapers and magazines, particularly, have content and consumer-facing brands that create a natural fit for ebook creation and marketing. For advertising, the stretch is a little greater and, frankly, we’ll be looking for pioneers that see the opportunity to promote their clients’ wares using ebook discovery and word-of-mouth as tools. It is inevitable that they will but finding the early visionaries will be the first challenge.

There is a new component of the advertising business called “content marketing” which also, ultimately, seems like a fit for the ebook business. What it means today is that a digital ad agency creates content which promotes a client or product; content which is meant to be found online and delivered for free.

There are two ways that book publishing could — and almost certainly will — be part of this new component, although neither seems to have happened with any regularity yet. One is that the agency-created content could be delivered as an ebook, not just as discoverable web content. This has probably not been the first instinct of the agencies for two reasons. One is that they figure that nobody would “buy” what they’re willing to give away for free. The other is that there’s a bit of a learning curve about how to process content into an ebook and put it into distribution. (Frankly, if you’re willing to live with the ebook being made available only through Kindle — which gets you much more than half the market — the learning “curve” is just about a straight line. Amazon makes it pretty damn simple.)

My niece, Kailey Moran, writes a blog about cars for women for a marketing company called Reynolds and Reynolds. It seems to me like a short step for her to put together an ebook for the same audience on the same subject. Her company isn’t doing that yet. I’m betting that within the next couple of years, they will.

There will also be new interactions occurring between college textbook and school publishers and their counterparts in trade. The educational publishers are moving from being primarily creators and distributors of “textbooks” to becoming creators and managers of “learning platforms”. These not only attempt to contain the syllabus and pedagogy that was in the textbooks, they also provide teachers with monitoring and assessment capabilities. And they will also be the environment in which the required and supplementary reading — often of trade-published books — will take place.

That will increasingly put the educational publishers in the role of aggregators for their institutional customers. This is likely to be a difficult and contentious area for the next several years because trade publishers will have to be satisfied with a new business model. They have historically sold printed books either to institutions (the normal way things happen with public schools) or to the student end-users (the normal way things happen in private schools and colleges). In the latter case, they often are able to make a sale for every user. Doing so is an artifact of the physical world and will get increasingly difficult to do, but trade publishers are understandably reluctant to move quickly to models that pay them less for each use, even if they already sell one printed book for multiple users (over time, because the books don’t wear out) in school situations now.

So the school and college publishers and trade publishers are going to have to talk and I think interaction at Digital Book World could jump-start some conversations.

We are guided in our programming at DBW by our Conference Council, a group of leading industry thinkers — some independent but most of them executives within the industry — who meet with us to discuss the program and then provide suggestions on an ongoing basis for speakers and topics. To prepare for the meeting we schedule to discuss the agenda, we offer our Council the opportunity to offer their opinions about each of the sub-topics we’ve identified under the major headings. (It’s a 2-hour meeting with 30 people or so; we can’t discuss everything and I need the guidance to put things in priority order for time allocation.) This year, for the first time, we are seeking that same input from readers of The Shatzkin Files.

We will be looking to create good programming under seven major themes:

Publishing in a global economy
The changing publishing ecosystem (roles and relationships)
Data-driven publishing
Rethinking marketing
Developing business models
Technology and living on the cutting edge
Education and book publishing are developing a new relationship

If you want to help us decide what are the most important sub-topics under these headings, you can see how we break them down and register your opinion about them on our survey monkey poll. When our Conference Council meets, we will make them aware of the results of this voting, as well as the separate tally we’re keeping of the vote by the Conference Council itself.

And an extra robust thank-you for anybody who can suggest a sub-topic that should have made the list and didn’t.

We don’t really understand the ways of Feedburner, our current (but soon to be past) distributor of the email version of this blog, but it didn’t distribute my last post about when an author should self-publish. So if you’re getting this one by email and didn’t get the last one, we’re trying to make it easy for you to read it now by clicking this link. We will soon be moving over to Mail Chimp so these problems will be in the rear view mirror.

There is a question that every agent and publisher is dealing with, because authors surely are. And that’s this: when should an author self- (or indie-) publish?

The answer is certainly not “never”, and if there is anybody left in a publishing house who thinks it is, they should think a little harder.

For a number of reasons, the belief here is that most of the time for most authors who can get a deal with an established and competent house, their best choice is to take it. It’s good to get an advance that is partially in your pocket before the manuscript is even finished and assured once it is. It’s good to have a team of capable professionals doing marketing work that authors are seldom equipped to do well themselves and which can be expensive to buy freelance, particularly if you don’t know how. It’s good to have a coordinated effort to sell print and ebooks, online and offline, and it’s good to have the supply chain ready for your book, with inventory in place where it can help stimulate sales, when you fire the starting gun for publicity and marketing. And it’s great to have an organization turning your present book into more dollars while you as an author focus on generating the next one, and start pocketing the next advance.

Publishers have heretofore really had only one model for working with authors. They acquire the rights, usually paying an advance-against-royalties, and own and control the entire process of publishing. It is generally understood that all efforts to make the book known can show benefits in all the commercial channels it exploits. So publishers have generally insisted on, and authors have generally accepted, controlling all the rights to a book when they pay that advance. The two pretty standard, time-honored exceptions have been cinematic (Hollywood) rights, which are rarely controlled by the publisher, and foreign territory and language rights, which are only sometimes controlled by the publisher.

Since publishers until very recently effectively monopolized the path to market, they could effectively make the rules about what an author could publish. That usually has meant no more than a book a year. It has also usually eliminated anything that isn’t “book-length” or that needed to reach the market very quickly upon completion of the writing. And in a practice that ultimately has had painful consequences for publishers, it meant backlists went out of circulation when a title wasn’t worth printing in bulk.

And these make up a very good starter list of when even an established author might want to consider an alternative to the conventional publishing arrangement. (It goes without saying that a fledgling author with a completed manuscript might choose self-publishing as a way to start their commercial career in preference to canvassing for an agent and then, if that quest is successful, waiting for the agent to find a publishing deal and the publisher to get the book out. Self-publishing could conceivably speed up the whole process of finding a publisher!)

Although most of the Strum and Drang around how digital changes the publisher-author relationship have been about the royalty rate — publishers tend to want contracts that specify a royalty of 25 percent of revenue on ebook sales, various upstarts and digital-first publishers pay 50 percent and an author going directly to the retailers can get even more — that is, for most authors, less of a problem than it might first appear. For authors who don’t earn out advances, it isn’t a real number and the effective royalty is higher than what the contract says. And whatever the difference is in dollars, it doesn’t come without the requirement of work and sometimes costs — like a copy-editor or a cover designer or a marketing advisor — that would otherwise be borne by a publisher.

Where royalty rate is most consequential is for authors with a substantial reverted backlist. Since they begin their self-publishing efforts with equity built at least partly on a publisher’s back, they have a decided advantage over a fledgling self-publisher. Several authors have done very well for themselves building out from the platform of personal name recognition and titles somewhat established in the marketplace. The first of the obviously successful self-publishing authors was Joe Konrath several years ago and that’s how he started. Others have followed in his wake. And although the work required to self-publish and market yourself effectively is not trivial even if some readers know you and some of your work, it is also considerably more likely to result in a useful financial reward than trying to self-publish from a standing start. And certain chores, like editorial development and copy-editing, are eliminated by starting with already-published material.

In these cases, the loss of inventory-in-place at stores is less of a handicap to discovery than it would be for a new book and the additional margin on ebook sales could well leave the author making much more money, even without a promotional print sale.

But, for many authors, the frustration with publishing the conventional way might not be about money at all. Writers often write just because they have something to say, or a story to tell, and they want both to express it and have people read and react to it. That’s where the “shorter than a normal printed book” or “must get this published in weeks, if not days” barriers publishers have always presented become mere annoyances that anybody with a modicum of initiative would simply brush aside.

All of these motivations — monetizing previously dead backlist and getting to the public with material even a successful author would have difficulty getting a publisher to do — are behind the fact that the big literary agencies are staffing themselves to help authors navigate the digital world. In different ways, we have seen this emerge at Writers House, Trident, and Curtis Brown, among others. And another way this can work is demonstrated by the Waxman-Leavell Agency, which has spawned a new ebook publisher called Diversion. Diversion followed a path blazed more than a decade before when agent Richard Curtis started EReads (recently sold to Open Road) and lawyer-agent Arthur Klebanoff founded the still-operating Rosetta Books.

In other words, the gap between pure self-publishing and traditional publisher-author deals grew wide enough that the agents saw the need to fill it.

The strength of the traditional publishers and the traditional deals is directly related to the amount of the market that is served by inventory in stores. When that proportion was “nearly all”, the power allocation was “nearly all” to the traditional publishers. During the period when this was shifting quickly and the online share was rapidly depleting the in-store share — a few years ending a year or two ago — there was what felt like a rush to self-publishing combined with the growth of digital-first publishers, the reigning giant among them being Open Road.

The traditional publishers are starting digital-first imprints now that can do deals with different splits and handle both shorter books and faster publishing than the classic model. The upstarts like Open Road, Rosetta, and Diversion have built lists and businesses on the gap — in business jargon, “the delta” — between the traditional deal and pure self-publishing. The hunch here is that gap is going to get progressively smaller. The big guys will figure out commercial models to do shorter books and get to market faster. They’ll raise royalties (or unearned advances, which amounts to the same thing) to keep proven writers in the fold. Eventually, houses will give their acquisition editors the suite of deal templates they need to keep diminishing the incentive for an author to step away from the house to get something done.

And while there will always be an opportunity for a known author to make a bit more per copy if s/he takes on many of the functions of publishing her/himself, the amount of backlist available to be capitalized on in that way will shrink inexorably over time.

Self-publishing and new-style digital-first publishing can grow more to the extent that the book-in-store share of the market shrinks more. But while that’s happening, the big publishers are also adding to their capabilities: building their databases and understanding of individual consumers (something that all the big houses are doing and which the upstarts seem not to believe is happening, or at least not happening effectively), distributing and marketing with increasing effectiveness in offshore markets, and controlling more and more of the global delivery in all languages of the books in which they invest.

It will compound the pressure on the alternative players if Amazon continues to grow its global market share for ebooks. The bigger the percentage of the market that can be reached by self-publishers with one stop at Amazon, the less interest they’ll have in picking up smaller chunks of the market with additional deals and the more powerful will be any incentives Amazon cares to offer for making the title exclusive to them.

There has always been — and will always be — a great diversity of publishers. But the commercial concentration will continue to be in a small number of big English-language houses for many years to come even if the number of self-publishers appears to continue to grow.

We are really excited at the enthusiastic response we’ve been getting to our new Logical Marketing Agency business. If you have anything to do with marketing books (or brands) online, you’ll want to know about what we’re offering.

Today Peter McCarthy and I are formally announcing a new business which is a partnership between us: The Logical Marketing Agency. What we’re doing is applying the most modern and sophisticated digital marketing techniques and capabilities to the challenges faced by book publishers and authors — and therefore agents — and, because the same techniques apply — also by brands.

This business has been in gestation for about 18 months, since Pete and I first started working together on other projects. We are building on what he learned during nearly two decades in publishing, first working for The Reader’s Catalog and then The New York Review of Books, followed by six years at Penguin very early in the digital transition, and then six years at Random House. At Random House Pete’s job was, explicitly, to figure out how books would be sold in the future. So for several years he was tasked with experimentation, using the books from publishing’s most extensive and diverse commercial list and the resources of the world’s biggest trade publisher.

As my Idea Logical colleague Jess Johns and I came to realize how much Pete knew about the digital marketing challenge all publishers are aware is important but woefully under-equipped to tackle, we saw the great opportunity in “scaling” him. The Logical Marketing Agency is our vehicle to make Pete’s knowledge available and useful to every publisher or author who wants to make use of it.

Over the past six months or so, we have done initial, relatively small small digital marketing jobs for more than a dozen clients. They have included both major and smaller publishers in the US and the UK, authors, literary agents, and brands that aren’t publishers. By working with this initial group of beta clients, we have learned how to shape our offerings to directly apply what we know to publishers’ and authors’ and agents’ perceived needs and pain points.

First we thought about the two key elements that need optimizing: titles and authors. Titles need easy discoverability; they need to be found in the right places, at the right time, by the people who are likely to be interested in them. This often involves a nuanced understanding of search as it exists in environments like Google, Amazon, Apple, and others but can also encompass other means of enhancing a book’s reach into its likely audience(s). Authors need optimized web presences, so that their credibility and personal networks are grown and enhanced regularly and so that their reputation as authorities on the subjects that matter is confirmed on the Internet.

Of course, the key for titles is the metadata: the long and short descriptions of the book that are accessed by all the retailers and search engines and the BISAC (or, in the UK, BIC) codes that identify the book’s subject matter (and, therefore, its audiences).

Pete’s key insight about title metadata — one that is very hard for most publishers to accept, frankly — is that it can’t be done properly without research. You start by positing what the audiences for a book are or, in the absence of hypotheses, how to figure out what they are. Then you look for them online and find out more about the makeup of those audiences: who those people are, where they hang out online, what they’re interested in and what they believe, and what words and phrases they use when talking about the author or the subject(s) in the book. Then you have to research the search terms that matter, to find out which ones are used most frequently and by whom. It is probably not surprising to learn that the “right” search terms might not be identical in Google and Amazon. And from there, one can keep going, analyzing what Pete calls the “meaningful back end data” that results from good outbound social media marketing. You can learn who it is that is engaging with and what their beliefs are, where they live, and other attributes that can be used to properly position each piece of marketing collateral. And, that’s a process that can keep going for a long time if the vein is rich.

How long does this research take? If you know what you’re doing, it can be done in an hour or two. How many publishers have the know-how and the staff to spend a couple of hours researching before writing descriptions of all their new titles? According to what we’ve found over the past few months, the answer is “not many”. Or “almost none”.

Getting the descriptions and metadata right is what Pete (and the Logical Marketing Agency) calls “foundational”. You must do it or everything else you do afterwards sits on a shaky base.

But there’s another level of knowledge that can be helpful beyond the foundation. What can you do to further promote a title beyond getting its core discoverability right? Well, there are potential paid media opportunities (keywords you might buy or audiences you might target through well-placed banners or other ads). There are other books or other things that have audiences to whom the book would appeal that give keys to other potential promotions. Each of these can lead to further SEO efforts around an author or title web site, new social media tactics to employ and more. You can take what is gleaned in the original research to find new ways to target the audience and that chain, in some cases, can be extended productively many times. The research that turns up those opportunities is something Logical Marketing will also offer, through “comprehensive” title analysis, a deeper drive than “foundational”.

We are doing the same for authors, offering a “foundational” author audit and a “comprehensive” one. But for authors we have found demand for even more research and analysis. Major publishers have bought customized author audits from us for authors they wanted to poach from other houses and for authors of their own they wanted to do a better job for and, often, compare with other authors’ efforts. These are really in-depth reports, 50 to 100 pages in length and filled with data, interpretation, and actionable insights. They often require an execution team to handle implementing the suggestions, though, increasingly we will be offering those services as well. The more complex an author’s online footprint — whether from many books or from many other things in their career — the more work this takes, but the more value there is. A long career and a long list of prior books can bury the messaging to surface and focus on the current book. It is ironic that authors with the biggest online presence can be the most complex to maximize for a particular project.

Recently, we have had two of New York’s biggest literary agencies try us out. One of them was looking for a picture of how one of their biggest authors was doing. The other had specific objectives in mind for their authors and asked us to look at the online footprints of three of them — two very big, one a little less so — to recommend how to achieve those objectives.

There are two additional elements we have only dabbled with so far, but which could become a big part of our business and service suite in the future: backlist and running campaigns.

Getting the most sales out of the backlist requires two things working in tandem. First of all, the backlist metadata has to be optimized. That requires research too, although a bit different research than for a forthcoming title because people have read it and people have talked about it. That gives clues to audience and nomenclature that are much more reliable than what one can discern for a yet-to-appear book. If publishers don’t have the staff time to do by-title research for their new books, imagine how hard it would be for most of them to do it for their whole backlist. It is safe to say that no house is staffed to do this.

The other necessary piece to optimize backlist sales is a tool that will chart the news and social graph — trend analysis — that then can bounce each day’s developments off the backlist metadata to find titles that can benefit from current attention. Of course, that opens up the question of “what attention?” Sometimes a change in metadata will produce a big result, tying the title to current interest. But sometimes more effort will make sense, like a digital media campaign. This has, of course, been tried by certain houses and has sometimes been successful. But it is our belief that this kind of work has not been executed optimally. Paradoxically, often the problem is that it is done too broadly. But it is important work we have some new ideas about how to do it well and at a cost-effective scale and pricing.

And that brings us to the final component of our suite of services, for now. We will run digital marketing campaigns for publishers. We did one of these last Fall for a live event, rather than a book. Since our conversations with publishers and self-publishing authors repeatedly confirm that running campaigns is a real pain point — they know they don’t have the staff for it and they sometimes know they don’t have the skills or experience either — we see that as a big part of our business going forward.

Brands are like authors. They have online presences; they have reputations; they have audiences that have characteristics that, once understood, enable you to reach them better and to find them in other venues. In fact, authors are brands. Publishers know that and we believe that what we do for authors would work for many other brands.

So it is with high expectations and great confidence that we can be helpful that we launch this new business.

One thing we’re going to add shortly is a self-service offering for independent authors. The service organizations we know who do the tech and distribution work for self-publishing authors all say they need marketing. That looks like an opportunity to us. If you want to get ahold of us, you can email us at [email protected] A web site with more about our services has gone up at that address as well.

The London Book Fair is an every-second-or-third-year thing for me, going back many decades. From an English-centric perspective, it is like a mini-Frankfurt. All the UK players are there and a lot of US senior executives. But because it is so accessible to the Continent, you can get a taste of how things look to the rest of the world.

In the US, we look to me to be in a period when two dominant giants — Amazon for online bookselling and Penguin Random House for general trade publishing — are consolidating their positions. Amazon’s enormous market share is growing, both for print and ebooks. It is too early to draw the same conclusion about PRH, but my guess is that a year or two from now we’ll have seen them taking share from their biggest competitors just like Amazon is from theirs.

(Dominant giants will be part of a conversation I’ll be taking part in on a stage in London. I’ve been asked to participate in The Great Debate, where this year the proposition is ”It’s all about size. Bigger is always better.” I’m arguing the affirmative with Ken Brooks of McGraw-Hill Education as my teammate. We’re opposed by Stephen Page, the CEO of Faber, and Scott Waxman, who is both an experienced literary agent and the entrepreneur behind Diversion Books, a digital-first publisher. It should be fun. And friendly. We’re all nice guys.)

The dominant US brick-and-mortar retailer, Barnes & Noble, appears to be fairly healthy in its traditional business. It is shrinking, but the store operations are still profitable and well run. They appear to have benefited from the demise of its erstwhile competitor, Borders (as have the independents). From across the Pond, one does not get the same impression about UK’s Waterstones chain. However, in the UK, there are forces we don’t have in the US: not just the ubiquitous newsstand-type WHSmith stores, but also two supermarket chains, Sainsbury’s and Tesco, which are each ambitiously trying to build a book business and their own ebook channel. One thing I’ll be asking everybody about is the impact these retailers have in the book marketplace, particularly when we get beyond the top sellers. Perhaps if they’re doing well, it would encourage Walmart to get serious about bookselling. Certainly Walmart would like to do anything they can to poke Amazon in the eye.

Without serious competition from new players who are well-funded, like the UK supermarkets, it is hard to see what stands in the way of the global ebook giants: Amazon and Apple and, to a lesser degree, Google and Kobo. Perhaps I can get a sense in London of how Barnes & Noble’s multi-territory expansion for Nook is faring. But, however they do, there is a so-far little-noted effect beginning to become evident that could tilt the global book business to the English-language marketplace, and to the US in particular.

In a recent conversation, an executive at a Big Five company told me of a recent development. His company had licensed a few titles for Russian language rights to a publisher in Moscow. But by which retailers would most of those ebooks be sold? The answer is Amazon, Apple, Google, Kobo and Barnes & Noble! And the Russian publisher, really just breaking into the ebook business, has far more limited access to these retailing giants than the US publisher which had licensed them the rights.

So the US publisher, in a suggestion that seemed in everybody’s interests, offered to be the “distributor” of those Russian ebooks to the major accounts. The deal was made and it worked. I said to the executive who explained this to me, “You could be helpful in distributing all their books, not just the ones you licensed them.” “Exactly,” he said.

But then we took the conversation a little further. This house is wondering whether, in an ebook-dominant world, it wouldn’t make more sense for them to publish books themselves in Spanish, Mandarin, and French (the first three languages they are thinking about). After all, the translations are done by freelancers. Anybody can hire them no matter where they are. And if most of the books sold are ebooks, and if the publishers of English, especially those in the US, have multiple daily contacts with the big ebook retailers and others don’t, then what is the point to licensing away those rights?

That approach would mean that publishers in at least some non-English territories would, at best, be able to license the print rights for the local geography they really cover. And it would mean that the biggest publishers with the biggest checkbooks to sign the biggest authors and titles will be able to benefit from an even larger share of the book’s global market while paying the author more than they could earn with a local publisher sharing in the other-language rights.

If this is more than one company’s inspiration right now, I should be able to find evidence of that at the London Book Fair.

The other thing for me to learn, of course, is how digital marketing of books looks from the UK. In our fledgling new business with Peter McCarthy (take a look at his new post) we have already done some title optimization work for two UK-based publishers, one large and one medium-sized. So we’ve learned how to do the work using UK-based Google and Amazon and putting BIC codes rather than BISAC codes into the metadata. We’ll be formally announcing the new business and opening our web site the day before the London Book Fair opens. I expect to find a lot of interest in what we can offer, just as we have in the US. There is no doubt that the London Book Fair presents the best possible opportunity to find out very quickly what our own opportunity is outside the US as the need for sophisticated marketing naturally follows the growth and increasing complexity of the overall digital environment.

One person I will be sad not to see at London Book Fair is my longtime friend Bruce Robertson, a founder of the pioneering packagers The Diagram Group, who died a little over a week ago at the age of 79. Bruce was sui generis: a brilliant man with a unique gift for visualization that was the guiding spirit behind dozens of global bestselling illustrated books. Forty years ago, I had the opportunity to sell three of Diagram’s greatest books, “Rules of the Game”, “The Way to Play”, and “Man’s Body” when Bruce’s publisher at that time, Paddington Press, was distributed in the US by my family’s distribution company, Two Continents. I always enjoyed seeing him and hearing his witty, insightful, and often cutting take on the people and practices in our business. Fortunately, there were many opportunities to see Bruce and his endlessly good-natured wife, Pat, over the years, at industry events or when he was in NY or I was in London. We are all one of a kind, but some of us are more obviously so than the rest of us. Bruce was like nobody else. He’ll be missed by many friends from all over the world.

Doing business development for my Logical Marketing partnership with Peter McCarthy (we are on the verge of formally announcing our new business) gives me repeated and continuing confirmation that Pete just knows more about digital marketing than anybody else in publishing. This is partly because he’s a damn smart geek with a marketing-oriented brain who grew up in publishing. It is also because he had the good fortune to be effectively running a marketing experiments lab for the world’s largest publisher for six years.

We recently had three examples from three different Very Big Publishers with Very Smart People of mistakes, or misunderstandings, or structural paralysis, that seem almost generic. All of them involve challenges that every publisher faces on a daily basis.

The first is from a publisher which is among the first to take a step that all publishers must take eventually: optimizing the metadata for their backlist. (Backlist is a topic that has interested us for a long time.) This is a mammoth challenge for every publisher of considerable size. They have tens of thousands of titles and, often, many of the ones selling best will have been published years — or even decades — ago so that nobody among the editors or imprint marketers have read it or thought through the markets for it, except when traditional reissuing activities have occurred or an exceptionally sharp marketer saw an opportunity.

There really are two distinctly separate problems inherent if you want to maximize backlist sales in the digital age. One is the one they are tackling: to get the foundational metadata — the book descriptions and their placement in the information chain — solid so that the titles are called up in response to the searches suggesting a possible customer for them. The other is to build a mechanism to observe the news and social graph each day and to identify the titles that can benefit from new developments. And then, of course, to couple the two in order to optimize a given title or series for the most appropriate semantics to drive both discoverability and conversion in different environments. SEO, yes. But really nuanced and real-time SEO which accounts for fundamental changes in how all the engines work and subtle differences inherent in each. We have our ideas about that engine (and have developed a proposal to address it) but, for now, like that publisher, let’s just worry about the first challenge: getting the backlist metadata foundations right.

The pioneering publisher we encountered is addressing the question across the many imprints in their large organization by asking each one to work on the metadata for their top-selling backlist. What this means, in practice, is that fuzzy-cheeked editorial or marketing assistants — most operating with little direction from senior people and, frankly, mostly working with senior people who wouldn’t really know exactly what to tell them to do (this stuff has gotten very technical in nature) — are the ones looking at what is there now (if anything) and fixing or updating it. This house will inevitably find that they get very uneven results and, because most of the work will be done by low-level people who turn over (or get promoted) quickly, it will be hard to generate training or processes that will show steady improvement of this work in the future.

Unless some great care is being exercised to introduce procedures most of these people would be unlikely to know about, this also runs afoul of Pete’s repeated mandate that research must be done for each and every title before a marketer can create optimized metadata. For backlist, in Pete’s methodology, this starts with finding out who the people are who have already read the book and commented on it and what words they use when they describe it. LibraryThing tags and GoodReads reviews are key sources for that, but for us LT fits into an overall workflow and orchestrated use of tools that Pete has developed and trained our team to to employ to thoroughly crack this particular problem of “how readers think about, talk about, and feel about” a given work or author or brand. LT and GoodReads provide critical insight to cement or alter the context in which a book sits.

So, aside from the massive distraction created by asking each imprint to take on such a substantial additional chore, the chances are good, actually overwhelming, that the results — the new metadata foundations that will be created — will not be thoroughly applied and optimal in the best cases and that most imprints won’t be as good as the best. And, in a problem that repeatedly bedevils publishers in the age of digital media (as we will see again below), the staff time to do this exercise is not readily available. Everybody doing this work already has a fulltime job, largely jobs managing author talent and frontlist, jobs which must be done.

In another case, the Chief Marketing Officer of a large publisher — one who has heard Pete speak, knows me, and is firmly committed to trying our services — talked with me about what he presumed would be Pete’s many ideas about how to apply a full-text search of a book to improve the marketing. I thought he would fall down when I told him, “Pete doesn’t believe in reading the book so I don’t think he’ll want to apply a full-text search.” My CMO friend was immediately skeptical so I told him what Pete has told me. “I’m marketing to people who haven’t read the book.”

There are definitely some situations in which you’ll want to pull things out of a book’s text, although I think they’re almost always about proper nouns. If you’ve got a biography of a baseball star and there are stories about teammates and opponents, you’ll want those names in the metadata to signal to searchers on those people that there is relevant material for them in the book. But, in general, full text doesn’t help.

You hone marketing metadata by looking hard at the markets, not at the text. The task begins by describing the audiences as precisely as you can: “teachers” is good, “high school science teachers” is better, and “high school science teachers with kids of their own” is better still. Then you find those people, learn where they cluster, and how they talk, and how they seek information. You apply the knowledge of what semantics they use and bump that against the terms that are searched in different venues to hone your pitch. There are shortcuts to get this work done (and we try to use them) but the application of a full-text search of the book is not one of them.

Experimenting with what is known as A/B testing, whenever you can do it, is critical. (It is admittedly difficult, though not impossible, to do it effectively in advance of publication.) Any media outreach campaign that is not utilizing A/B testing is doomed. Any digital marketing that is done without A/B testing is amateur hour.

And that brings us to the third time this month that we found with pretty near certainty that a big house was proceeding without knowledge Pete has.

We did an online audit for an author who is in the news. We found some circumstances which seemed to call for “paid media”: the purchase of search terms and phrases (ones on which major retailers had not bid and for which the book was not surfacing organically) or contextual display ads around news breaks to call attention to this author and his book in particular cases where we (really, Pete) believed it would do some real good.

So we made the suggestion to the top digital marketing thinker at this big publisher. He reported back that this kind of campaign had never worked for them, even tried on a big scale. Once again, Pete’s experience suggested to him possible reasons why it hadn’t worked for them and how it might. Pete told me:

The houses (almost to a one) do not know how to run these promotions, track their efficacy properly (they do broad “last-click” attribution, which is likely to capture a third of the actual effect, or so), and they make them amazingly expensive for themselves by not optimizing for the goals or for the platform, which at once benefits the platform and them.

Despite nearly infinite inventory, these places (the online venues) prefer that users click on ads when they see them. The better you are at it the cheaper those clicks are. Then you track the clicks and augment your attribution model with the known amplification effect (conservatively apply a % applied across outlets and formats per studies or in-house knowledge).

Drive a nice conversion percentage at Amazon and the book begins to rise. By rising, it gets better “placement” on Amazon via algorithmic store optimization (e.g. merchandised in the cart). That’s a virtuous circle that has momentum of its own.

So, once again, the problem seems to be that the targeting is too generic, using broad matches in AdWords and not applying negative keywords and the like. There is an outright lack of — or too little — A/B testing and segmentation, and there is no constant adjustment of the media buy reacting to the response. It turned out that a further conversation with this publisher revealed that their particular problem was around clearing the staff time to gain expertise and actively research and run these paid digital media campaigns, which, we agree, is not trivial.

Digital media is cheap to buy but expensive to manage.

The net effect of this is that potential consumers are in essence seeking the book but publishers are not putting the book in front of them because it is too inefficient to do so. The answer would seem to be to make the process more efficient rather than missing the opportunity. That’s why we’re training capable but less-expensive help to deliver that service as well.

All of these examples are real and all of them are recent. All of the people laboring under what looks to Pete (and therefore “to us”) as erroneous understandings of how best to apply digital marketing are smart and sophisticated. And I wouldn’t have been able to provide better answers, or discern any problems with their answers, a year ago. But what Pete McCarthy knows was learned during six years working alongside many forward-looking colleagues (and a management) who remain at the Random House part of PRH, and much of what we’re planning to deliver is almost certainly already baked into their workflow to a certain extent, although (like most big publishers) largely at the imprint level and therefore with varying levels of focus and capability.

Many of the obstacles to competing effectively with the World’s Largest Trade Publisher are obvious. But not all of them. It would also appear that they also have the hidden advantage of already having incorporated much of what Pete McCarthy has learned into their digital marketing practices. This will not be evident to other publishers. It will be evident in PRH’s sales and in the (lower) cost of getting them.

And what I’ve described above are merely a few of the marketing principles of Pete’s as we see their importance in specific examples. The ramifications of applying the broader set of capabilities implied by these principles, and what could be built or taught to scale, are massive. Just think of what a 5% increase in backlist sales can mean when a house’s backlist consists of tens of thousands of titles!

We are building the Logical Marketing web site right now and will formally announce the business, with services tailored to publishers, agents, authors, and brands very shortly. It will include a self-service portal for self-publishing authors. But we are already applying Pete’s knowledge on behalf of publishers large and small, two prominent literary agencies, and several independent authors. If you’re interested in getting more information about these services, an email sent to [email protected] is the way to let us know.

Since the merger that has created Penguin Random House, there has been precious little speculation (except by me, as far as I can tell) about what this new behemoth in trade book publishing could do to exploit their scale in new and innovative ways.

Their scale advantage is huge. PRH has something in the neighborhood of half the commercial trade books published, bestsellers and below. (You see numbers as low as 25% for this and most of the time estimates put it around 40%.) For several decades, the big US book clubs — Book-of-the-Month Club and the Literary Guild — demonstrated that having about half the books was “enough” for very large numbers of people to feel comfortable that their choices of what to read from within that group of titles would be sufficient for most of their needs.

My initial hunches, still totally unrealized, were that PRH would launch a subscription service with just their own books and, through the use of vendor-managed inventory, create exclusive channels of store distribution that wouldn’t be available to any of their competitors. (One senior executive from a competitor to whom I described this scenario said candidly, “we’d make our best books available to them for their proprietary channel if it were the only way for us to get the distribution”.)

One PRH executive kindly explained to me the company’s inherent resistance to the subscription model, which would seem to appeal most to the heaviest readers looking for a bargain. As the largest player in the market, PRH isn’t looking to reduce the spending by the people who are the biggest sources of industry revenue, which a successful subscription offer would inevitably do. (That subscription model, or “Netflix for ebooks”, is complex in ways that are often ignored, but which Joe Esposito spells out very clearly.) Of course, that doesn’t mean the company wouldn’t consider it in an environment where subscription services were taking a big part of the audience (certainly not the case yet, but watch what happens if Scribd or Oyster or Entitle or the new Rooster succeed). It does seem to say that they won’t be pioneers in this field. And there is no sign yet that they’re taking up my idea to use VMI to create their own bookstores, either.

But PRH UK — echoing what was said to me by RH US CEO Markus Dohle some years ago — has now announced it is becoming a consumer-focused publisher. Hannah Telfer, who was made “group director, consumer and digital development” in January, says discoverability depends on “building a direct relationship with consumers”. And she claims “our scale” is a key enabler of doing this “properly”. This is refreshing, since most of the industry thinking about how they would use scale seems to be more about consolidating warehouses than getting smarter about talking to consumers.

One article in The Bookseller details staff changes and initiatives around this goal. (And another expresses some skepticism about whether their plans are adequate to the task. That second piece suggests they need to think about selling direct, a recommendation I have expressed some reservations about.) On the one hand, the first article suggests some really broad, company-wide objectives, including “the potential for Penguin Random House to be a cultural and entertainment powerhouse; a home for all audiences”. At their recent sales conference. CEO Tom Weldon described the opportunity for PRH “to create the blueprint for a publisher brand as a consumer brand and, in doing so, capture the attention of the world for the stories, ideas and writing that matters”. That sounds like one big brand.

At the same time, there was clear acknowledgment of the importance of what we call “verticality”, or “audience-centricity”. An “audience segmentation project” was announced. So was cross-imprint attention to specific subjects, with “cookery” and “crime” cited. One tool that it is clear Penguin Random House has and will use is called Bookmarks, described as “the Random House readers’ panel”. New plans call for it to “become a PRH resource, giving all parts of the business access to over 3,500 readers through surveys and focus groups”.

Of course, the more different ways the company wants to use that panel, the more difficult it will be to get meaningful data from it. In fact, it would seem that what is really called for is an ongoing “panelization” process, by which new people are being added all the time to a number of panels that can answer questions about different communities of interest. One panel can’t serve all purposes.

This brings two topics into bold relief that have not historically been part of a book publisher’s thinking or skill sets.

1. It calls for new and nuanced thinking about brands.

2. It calls for a multi-faceted plan for engagement with individual consumers.

Advice directing publishers to think about branding for consumers is plentiful these days. Since I first started thinking and writing about publishing and brands, something disruptive occurred which I wasn’t thinking about at the time: self-publishing. My original notion was that the challenge was establishing brands with clear vertical, audience-centric identities. Probably the best example of doing that successfully in the big US houses has been Macmillan’s establishing of Tor as a brand for science fiction and tor.com as a destination site for science fiction devotees. It is well over two years since I wrote about tor.com having hundreds of thousands of email addresses that they could address with promotions that got very high open rates.

Tor.com gives Macmillan’s science fiction list a clear label of not-self-publishing. But outside Tor, for their general list, Macmillan uses many imprint names. A novel might be published as St. Martin’s, Holt, Farrar Straus, or Thomas Dunne Books (among others), each of which probably has “meaning” to buyers at major accounts, big libraries, and major book reviewers, but which means precious little to the general public. Does the average person know those names better than they know, let’s say, Thomas & Mercer (the new imprint of Amazon) or Mike & Martha Books (a name I just made up)?

(Please note that Macmillan is being used here for illustrative purposes; every major house has the same issues with imprint brands that are really intended as B2B signals, not for the consumer.)

But ultimately, it is important for Macmillan, and for every publisher, to stamp “major publisher” on their books to let the public know “this is from a long-standing and established book publisher” on the assumption, which I would share, that people who don’t know the names would still trust an institution rather than a self-interested individual to “pick” their books.

(Obviously, most people choose their books because of the author, the subject matter, a recommendation from a friend, or even based on some combination of the cover, the description, and the price. How much of the audience would be influenced by knowing that a major publisher was behind the book? We don’t know that, and we don’t know whether that number will grow or shrink based on the always-increasing output of self-published material that has not gone through a publisher’s editing and formatting rigor. And, by the way, doing aggressive branding means the publishers need to pay even more attention to their editing and formatting. Each instance of an inferior branded product hitting the marketplace will weaken the value of the brand.)

So here’s the rule about branding. Each major house should pick one name that is an umbrella. It goes on every book to establish the company as a major source of quality literature, enjoyable reading, and book-packaged information.Trying to target more precisely than that should be the job of the “imprint” brand under the umbrella brand. And that brand should be vertical, identifying subject or audience. That’s Tor in the Macmillan example above. Note that right now Macmillan is not a brand being used by any of the US companies in the Macmillan family.

The plan for engagement with consumers is much more complicated and has many components. One is simply collecting email addresses and permissions to ping people and then utilizing them. Turning almost all the marketing efforts you can into components of an email-gathering machine is a big part of this. This is a game everybody should be playing: all the retailers, all the publishers, and all the authors. We know from recent assignments at our digital marketing business that the smartest literary agents are figuring out how to help their authors do this. We can’t be far from the day when an agent will routinely ask a publisher “how many relevant email names do you have to promote my author’s next book to?”

But email lists, as the PRH UK statements suggest, are just one aspect of consumer engagement. And the statements from PRH also implicitly claim that a much bigger company has advantages in pursuing it. Aside from their ability to analyze existing email addresses among their signups or that they find through other means (hitting their web sites, self-identified in social media) to understand and reach audiences better, large companies can create special interest verticals to pull traffic (driving email signups) and give themselves a range of promotional opportunities. We see Simon & Schuster doing a lot of that kind of work. I’ve become a daily fan of “250 Words”, an email from their new business book web vertical that summarizes the core proposition of a business book every day. Whether that, or other vertical efforts of this type the house is trying, can turn into a remunerative web community or even a good place to get a book launched, is still an open question. But it is the kind of experiment that could produce a launching pad that could really help S&S with business books.

We touched on the notion that creating dynamic panels of consumers to tell you things — things you can ask all the time — is also a real value. We are aware of a niche magazine which routinely uses Twitter to ask its readers for opinions about various things, like what angle to take on a story. They get very fast responses that way. We know that Osprey, the military history publisher, routinely asks its audience for opinions when they are choosing among subjects for development of a book. (And it is relevant to note that Random House UK has hired Osprey’s energetic and visionary CEO, Rebecca Smart, to run their Ebury imprint. That’s another way to employ scale: hire away the best smaller-company executive talent!)

A good approach for a big house that can harvest large numbers of email addresses would be to routinely ask consumers whether they would like to be polled about questions that will guide the house’s publishing and marketing strategies. Doing that would give them fresh names all the time. What Osprey does with their specialist audience could become routine practice to a house with a big enough email list. Consumers could be asked about whether a topic is a good one to sign up before the house makes a commitment. They could also be asked about packaging and pricing. And if that kind of interaction were built into the house’s practice, over time they’d learn when consumer opinions are a good guide to follow and when they’re not (because they won’t always be!)

We are in the earliest days of big publishers changing from near-total dependence on intermediaries to reach their markets to having direct relationships with consumers. For now, most houses are pretty quiet about what they’re doing, partly because they think they’re inventing something and partly because they don’t know how well any of this will work. But relative silence shouldn’t be interpreted as relative inaction or inattention. It isn’t news to the big publishers that they need to talk to audiences directly. Penguin Random House has advantages of size relative to the others in the Big Five, but the rest of them have advantages of size relative to everybody else.

Note to readers: because of glitches and fiddling not worth detailing, the last two posts didn’t go out through our normal email distribution (which makes some people refer to this blog as my “newsletter”!) If you didn’t receive posts entitled “Getting Mark Coker Right This Time…” and “Sometimes One More Calculation…” they are linked here for your convenience.

On Tuesday, for the first time in the five years I have been writing this blog, I did a post I would like to take back. (But in the interest of the public record, and because there were several comments of value, I’m leaving it up.) This is the post that I should have written the first time.

Mark Coker, the founder of Smashwords, wrote a Huffington Post piece in which he asserted that indies are now responsible for 15% of the ebook market in dollars and on their way to 50% by 2020. The initial post of mine misread Mark, and assumed that the 15 percent and 50 percent claim were about units, not dollars. Mark set me straight, but, unfortunately, that other post focused on trying to translate what I thought were unit shares into dollar shares. Sorry…

At first I had thought I agreed with Coker’s overall numbers, because I thought an estimate that indie ebooks were 15 percent of the total units was reasonable, rising to 50 percent in six years. But dollars are another story. (Note: Michael Cader’s independent examination of the numbers determined that indie/self-published ebooks were, at most, 11 percent of the ebook dollars and probably less. Cader’s generous calculations put the unit share percentage at about double that, in the low 20s. I believe his logic and numbers would also support my view that it is something less than that, which would put me near to Coker’s dollar estimate for my units estimate: about 15%.)

If indie ebooks were 15 percent in dollars today, then they would be 30 or 40 percent of units because they are priced so much lower than publishers’ ebooks. Is that possible? I suppose it is. I thought in the middle of last year that in the aggregate indies sold the number of units equivalent to one Big Six publisher, but not anything like 30+% of unit sales (even though Howey’s examination of 50,000 Kindle titles led him to assign 27% of the units sold to indies.)

If they are 30 or 40 percent of units, and nobody I know has read any, does that suggest a cohort of people who really prefer indie ebooks and read them in big numbers? And if indie readers form a “separate” market, is it growing or is it static? In other words, do indie ebooks draw on a particular pool of readers, so that we have two separate competitions going on for eyeballs and ebook sales?

We note a piece this morning at Good EReader that calls for the segregation of the self-published titles at ebook stores, because their sheer number interfere with discoverability for publishers’ books. That’s bound to be an unpopular idea in many quarters, but it is something that could happen if any one retailer offers it as a choice to consumers (which is the way to do it: as a filtering choice, not a hard-wired default). If consumers liked it in one place, the practice could spread.

Regardless of whether there is one competition for readers for all books or separate ones for indies and publishers, wouldn’t we expect the flood of titles to make it harder for everybody to make sales? (This is a point that Peter Turner brought up in the comment string to the prior post.) Chances are, yes. And that could mean even more authors will be forced to go indie because publishers are likely to respond to a shrinking market and more challenging discovery by reducing their outputs.

But it is also true that more challenging discovery means more skill doing it and more tools to reach customers have value. So the ability of established publishers to have “better odds”, to get their books to rise above the “noise” of a large title output, should improve (relatively) over time.

Coker did a great service to all of us putting the ebook sales indies achieve into a larger perspective. And, in doing that, he might even have understated the current case for their importance.

What Coker did was point out that the 15% ebook dollar share for indies was within the estimated 30% of the market that is ebooks, 70% still being print. Doing math with his share number, he concludes that self-published ebooks are taking 4.5% of the dollars in the overall market. I’d put them at somewhere between half and two-thirds of that.

But, in fact, the 70% of the market that remains print contains a lot of titles that have very little, even no, ebook sales at all. These are illustrated books or reference books or even kids’ books that have not worked commercially in a digital version. We don’t know how much of the 70% of books that are print are “readerly” books that are equivalent to the 30% that sell in ebooks, but it isn’t nearly all of them. I think it would be conservative to assume that non-readerly books constitute 25% or more of the 70% of the market that is print, which would divide that portion of the market to be 52.5% books that have commercially viable ebooks (the 30%) and 17.5% books that don’t.

So the 30% ebooks overall is really more than 35% for the books that are real ebook candidates (and probably nearer 100% for most of the indie ebooks which would have limited or no print sales). In other words, the ebook share for the books that can work as ebooks is already a bit bigger than an overall summary would suggest. But, despite that, indie ebooks are somewhere in the low single digits as a percentage of industry revenue.

I think that’s very important to keep in mind. Indie ebooks are not yet commercially important if we think about consumer dollars. (But, of course, as Hugh Howey and Coker point out, the author keeps a lot more of those dollars.)

There are two big questions going forward.

1. How fast will the indie self-publishing ebook market continue to grow at the expense of publishers who do it for profit? (All of the calculations from Coker and Howey about the benefits to indie authors assume they do it themselves, not through some new-fangled indie-first publisher or aggregator. If they do it through anybody else, new or old, the author share will decline. Every participant takes a cut.)

2. For any individual author, how does the decision of whether to do it themselves or sign with a publisher look?

On the first, I think one key question is whether we now have a bifurcated market: one group of people reading the bulk of indie books and another group reading the bulk of published books. There is certainly reason to believe that we do, although this is something that only the retailers really can know for sure.

I believe we do have two markets. Part of that is genre-driven. Many readers who habitually consume romance, thrillers, and sci-fi have found less expensive digital-first and author-published alternatives perfectly satisfying. They read lots of units. So it is likely that a concentrated cohort of readers is responsible for a big chunk of the indie books.

(There is probably a third market because we know there are also bargain shoppers. Though traditionally-published titles are discounted, there are still price bands where the indies largely own the marketplace.)

If that is the case, then indies compete with indies more than they do with publishers. And since we believe that a big part of indie sales growth will be driven by indie title growth, it could be that the sales will have trouble keeping up with the titles. That would mean the path to success for each individual indie author would get harder.

Note that this would not affect a self-published author who had built a name and a brand by being published first, except to the degree that self-publishing gets handled differently by retailers or that discovery metadata is not as professionally produced. In general, the distinction between authors who had publisher help building their brand before going indie and those who created success from a standing start has not been underscored as much as it should be in these discussions.

And that leads us to the second point. As Coker has pointed out in his piece and in the comment section of my previous post, some authors like to have “control” of their process. As print books become less and less important, those authors have more and more inherent reason to be attracted to a self-publishing model.

I believe that those authors who like “control” are already more ubiquitous in the self-publishing world than in the overall population of commercially-capable writers. It stands to reason that they would be early adopters of the digital self-publishing opportunity. My hunch is that most authors want to write, and to let publishers handle their business. They don’t want to do the administration and marketing work necessary to self-publish. And that’s even before they get to the difference between getting paid in advance for a book and having to spend money to put a book out.

But it is also true that the deals we see today are not necessarily forever. Publishers have held the line on 25% of their revenue as the author ebook share (apparently with some limited exceptions and, of course, situations for big authors where unearned advances effectively deliver higher royalty rates on everything). If they have to raise royalty rates to keep authors, they probably will. E-only publishers and digital-first imprints at traditional houses are already establishing new standards. Amazon just reduced the author take through their Audible subsidiary. Will the day come when they decide to take a bigger share of indie author ebook sales? Why not?

Authors will have a shifting set of commercial propositions to consider, along with their personal preferences for “control” or “help”. And that’s before we get to other things not reflected in any comparison of what they earn from a self-published ebook versus a publisher’s ebook: print revenue, unearned advances, and having somebody else doing a lot of work on your behalf.

So while I largely agree with Coker’s 10 trends that will lead to enormous growth in the number of indie-published ebooks we will see, I think a grain of salt is needed about how economically significant they will be either for the industry at large or for the vast majority of individual authors following that path even though they are bound to grow quickly. It turns out that the previous post started out with a misunderstanding that led me (and therefore my readers) on a wild goose chase but, in the end, the headline message was right. Even over the next few years, the changes we’ll see around how authors get their work to their readers are more about evolution than revolution.

As it happens, The Great Debate at the London Book Fair is about whether big publishers or small publishers will “win” over time. Ken Brooks of McGraw Hill Education and I have the “big” side; Stephen Page of Faber and Scott Waxman, who is both a literary agent and owner of an ebook publishing house called Diversion, tout the “small”. Michael Healy of CCC moderates. If you’ll be at LBF, check this out.

Author’s warning: this post is largely wrong! The following post was written based on a fundamental misunderstanding, assuming that Mark Coker’s post was talking about ebook sales in units when he was talking about dollars. 

Mark Coker, the creator and owner of Smashwords, very likely the biggest service-provider (after Amazon) for ebook creation and distribution for the self-publishing community, wrote an article on Huffington Post today with the headline prediction that independent publishing could be responsible for 50 percent of ebook sales in 2020.

While Coker does engage in some red meat slinging that will please the indie author and publisher cohort that is his bread and butter (painting a Manichean view of heroic indies on one side who believe their growth is inevitable and the blinkered establishment on the other side that considers the indie view “delusional”), his methodology is sound and his predictions are pretty reasonable.

But, unfortunately, Coker’s analysis stops one calculation short of painting a meaningful picture. And that calculation is the one that counts. Literally.

Coker figures that the current share in 2013 of ebook sales garnered by indies is 15 percent. He posits that print is 70 percent, so the indie ebook share gives them about 4.5 percent of the total market. That’s correct, if you are talking about units sold. And that’s where he stopped, but shouldn’t have.

Because indie ebooks generally are priced between $0.99 and $2.99 (although some have pushed that to $3.99 lately), and publishers’ ebooks are generally priced from $7.99 to $14.99, what Coker calculates omits an important reality. We’d have to guess what the multiple should be to translate unit share into dollar share, with publishers’ books listed anywhere from three to ten times, or even more, over where indie ebooks are priced. I’ll guess that a multiple of three times is a conservative estimate, taking into account that publishers’ prices are often discounted by retailers. (And I hope Coker would agree with me which I think is possible because on the numbers he stated, I agree with him!)

If 3x is the right multiple (and it is a lot less than the 5 to 1 ratio Hugh Howey found at Amazon for traditional publisher dollars over indie dollars), then indie ebooks really amount to around one-and-a-half percent of the book market by consumer spend. More than six years into the ebook revolution (if dated from Kindle, which is where I’d begin), that’s not a number that would justify the strutting of the indie ebook advocates and the slamming (and frequently predicted demise) of the publishers.

Of course, Howey and others have insisted that calculating consumer spend is getting the question the wrong way around from the authors’ perspective. What matters, they would say, is what share of author earnings fall to independent authors. And it is, indeed, likely that the well less than 2 percent share of consumer dollars would be a poor proxy for author earnings because sometimes (but not nearly always) authors make more money on a lower-priced ebook than they would have from a publisher’s sale of a higher-priced ebook (or a print book.)

The problem is that we have no way to make that comparison. We can’t actually calculate published authors’ earnings from sales and contractual percentages because we know that published authors get a lot of money in unearned advances. And we don’t know what indie authors earn either; it isn’t the frequently-bandied 70 percent of the consumer dollar all the time. (In fact, it isn’t 70 percent all the time even on Amazon.) With the price differential and many indie ebooks selling at 99 cents with the author getting about 35 cents of that, my hunch is that published authors actually average more cents per unit sold than the self-published do. At the same time, published authors are getting their take calculated on the price from which the retailer discounted, a higher price than the selling price. That means their royalty on the selling price is higher than even knowing the contractual terms would lead you to guess. And that is before you even get to accounting for unearned advances. So even getting 4.5 percent of the units would probably give them no more than 2 or 3 percent of the royalty dollars. And almost certainly that 2 or 3 percent is divided among far more authors than the 98 percent that goes to the published.

The heart of Coker’s piece is a checklist of reasons why the indie ebook share will increase. Most of those make a lot of sense. And his ultimate conclusion and prognostication, which is that ebook unit sales will be 50 percent indie by 2020, is not crazy. Maybe it will be 40 percent. Maybe 50 percent will come in 2023. But surely over the next few years the indie share of the total is likely to get bigger and the publisher share is likely to get smaller, even though publishers and other big players will increasingly be providing services to indies and alternative ways for them to work with established publishers on something other than the advance-against-royalties basis that has been the industry standard for many years.

But even then, we’re probably looking at something that is more like evolution than revolution. If indie authors have 50 percent of the ebook units by 2020, they’ll probably have half of 50 to 60 percent of the total market, assuming that print sales slip from 70 percent today to 40–to-50 percent in six years. If indies sold half of what might be a 60 percent ebook share of the market, they’d have 30 percent of the unit sales. But the pricing differential will still exist. (If it goes away, then indie sales won’t grow so fast.)

That means that, even by 2020, and even accepting indie champion Coker’s calculations, indie ebook sales will be around 10 percent of the dollar volume of the book business. And their share of total author revenue will be more impressive, perhaps in the teens, but still divided among far more authors than the much bigger number going to the published.

These calculations are not intended to disparage the indie writing and publishing community (most of whom get significant help from very big companies, starting with Amazon, to make them possible). It is intended to provide a reality check. The industry is still run by the establishment, and it will be for the foreseeable future. There are expanding opportunities for independent action and it is the right course for many authors, but the idea that we’re about to see some total reversal of fortune can be, and often is, wildly overstated.

As it happens, The Great Debate at the London Book Fair is about whether big publishers or small publishers will “win” over time. Ken Brooks of McGraw Hill Education and I have the “big” side; Stephen Page of Faber and Scott Waxman, who is both a literary agent and owner of an ebook publishing house called Diversion, tout the “small”. Michael Healy of CCC moderates. If you’ll be at LBF, check this out.

A recent post here that incited a long comment string and another on FutureBook that was quite unrelated from the estimable Brian O’Leary have helped me formulate some thinking which I hope can be helpful in evaluating any “Great Change” post that arises about publishing. And they do, indeed, arise often.

O’Leary’s post builds on a theme he is persistent about pursuing, which is that communication, which in his writing seems to conflate with publishing, is moving to a linked-and-continuous conversation rather than a set-content-package (like a book or a magazine). The post suggests that the “books”, such as they are, will emerge from the conversations.

This recalls for me a comment I heard a few years ago from the father of digital publishing, David Worlock. David told me, “surely, in time, the number of books created within the network must exceed the number of books created outside the network”. By “network”, David meant “Internet”.

I don’t know how long “in time” was intended to be in David’s mind, but I figured “decades”. And in that time frame, I agree.

The other long-ago wisdom I keep recalling as I read predictions about our digital reading future is what was always said by Mark Bide when we began our “Publishing in the 21st Century” conferences for VISTA (now Publishing Technology) in the 1990s. Mark always reminded the audience that “book publishing is many different businesses” so that everybody would keep in mind that what we said about trade might not apply to sci-tech and what we said about books for lawyers and accountants doesn’t apply to publishers of college textbooks. What brought everybody together was the form of the “book”, which was already then a weak unifying principle for what were really many very different businesses.

This is now more true than it was when Mark used to say it 15 or 20 years ago. In trade, which is the part of book publishing I know best, we are seeing that the business of publishing genre fiction is different from kids books, which is different from serious non-fiction, which is different from illustrated how-to, which is different from serious fiction. Travel books and computer how-to have suffered serious erosion, and some of us would expect to see cookbooks do the same, if they haven’t already. I base that notion on my belief that cookbooks, like travel and computer how-to, are books where “the unit of appreciation doesn’t equal the unit of sale”. O’Leary put it differently but makes a similar point:

The use of bundled media as the dominant form of shared content is ending. This trend has already affected newspaper, magazine and some types of book publishing. As readers look to customize their own content consumption, it will continue.

This makes me confess that I confidently and erroneously predicted in the 1990s to a close friend deeply involved with newspapers that they’d be “dead in five years”. I saw what Brian is talking about: that the bundled media idea meets its match when people can bundle their own. And I was directionally correct about the trouble the newspaper business was heading toward. But The New York Times is still dropped off at my door each morning (although I have often read a lot of it in bed on my iPhone before I cross the apartment to pick up the paper version) and most American cities still have a daily paper, even though many of them have bitten the dust in this century.

The extended discussion in the comment string of the prior post had to do with to what extent publishers serve authors, and to what extent authors are better off eschewing publishers and working on their own. Unless and until publishers turn digital marketing at scale into a clearly compelling proposition, their power to serve authors effectively diminishes with each closing bookstore. The less bookstore- (or brick-and-mortar retailer-) dependent any book is, the less additional benefit in sales and exposure can be delivered by a publisher (although a cash advance and somebody to handle all the business aspects of putting a book out will still be both helpful and persuasive to many authors). Bookstore shelf space, and printed books, seem to be suffering slower erosion over the past year or two than they did in the several years before that. Michael Cader has made a convincing case that we actually know that for a fact. But, even if we accept the fact, whatever erosion continues will affect different books and authors to different degrees.

As I was reading Brian’s post, which advocates delivering information with plentiful links that would allow reader-controlled exploration of the topic at hand, I thought about the book I am reading right now. That is Doris Kearns Goodwin’s excellent “The Bully Pulpit”. It’s complex and the web is loaded with material (about Theodore Roosevelt, William Howard Taft, and a cast of characters who were the muckraking journalists of the time) that could provide additional facts, depth, and color. But the valuable deliverable here is that Goodwin has sorted through all of that and more and delivered a masterful telling of a complex holistic story. That’s what I’m buying and enjoying. “Enhancements” would almost certainly undercut its core value to me as a reader. Links would just be distractions that would make me lose the thread of the coherent story.

Nonetheless, what Brian is saying might be true for me if I were reading a book explaining some aspect of economics or technology. And it might be true for a history scholar who was reading “The Bully Pulpit”.

So generalizations about the book business, whether they come from a self-published author or an industry expert like O’Leary, really require us to do a little parsing to make them useful. We’d be steering toward a more constructive conversation if we posed three questions every time somebody posits a Great Change we will see in the book business.

1. Which books, exactly, should we expect to be affected by this particular Great Change? This is necessary to specify now that most people would agree that “books” has become a pretty worthless generalization.

2. How soon can we expect a meaningful change in the perceived utility, and therefore the demand, for the affected books? That is, are we talking about a change that is already happening and evident and having a commercial impact (travel books are suffering and have been for years) or one we expect to see in the future (readers abandoning longer form books for shorter content choices) for which we might have only the scantiest evidence is affecting commercial reality today?

3. How likely is it that whatever the Great Change is going to be that publishers are well-positioned to affect or control or accommodate it? Brian suggested, and I wholeheartedly agree, the answer is “often not”. That being the case, the prediction of the Great Change should not necessarily be accompanied by the prescription that the publisher should change behavior to address it, although it seems to me they almost always are.

That last point is a very important one. Publishers, like all businesses, succeed on the strength of their expertise and their commercial network. Many would agree that the function of children’s books and craft how-to books could be better served if they utilized elements that are possible digitally — animation, video, interactivity, audio — and that would improve the utility of a digital version over a printed book. But does that mean that today’s book publishers can “own” that future business, if both the creative requirements and the marketing and distribution are well outside their prior experience?

Could a publisher of travel books have created Trip Advisor? Does the publisher-created Cookstr do the job of digital assistance for a cook better than allrecipes.com or cookbooks.com or betterrecipes.com? It doesn’t take a lot of deep thinking to see that a publisher’s skill sets are not the best match for building an interactive internet business where content is a component of the strategy but everything else about it is different from publishing books.

Over time, I expect the book business is going to get smaller, whether the number of books consumed goes down or not. Among the reasons for that is that, over time, the intrusion of self-publishing entities will be even more disruptive than self-publishing authors have been. Another reason is that wome information dissemination that has taken place in books will move away from books. It might also be true that the overall public appetite for reading longer forms will diminish, although any publisher with digital distribution can address that by changing the mix of what they publish.

Whether “book publishing” or “book retailing” shrinks, disappears, or changes form depends on how widespread across the various silos of interest and utility we call “books” today are the many disruptions that will affect those verticals in different ways and at different speeds. And generalizing about what these changes mean, let alone delivering advice that isn’t informed and bounded by an understanding of how any particular book or author or publishing program fits into the time and scale of any particular change, is as likely to be wrong and harmful as it is to be correct and illuminating.

So remember Bide’s decades-old admonition that the book business is not one business. It is the one generalization about books and commerce that has been true for well over a century and will continue to be true as long as books — printed or conceptual — continue to be something worth discussing.

The new Common Core standards, which are essentially descriptions of things kids should have learned and know by various ages and grades, are now being adopted and adjusted to by elementary and secondary schools across the country. Common Core, besides providing the standards, encourages the practice of educating kids using content not created expressly for an educational purpose. In other words, teach kids with regular books, newspapers, magazines, videos; not just with books and educational materials prepared by textbook publishers.

So Common Core is a new reality that would tend to encourage greater use of books from trade publishers in school settings.

The other new reality producing change in the school market for publishers is ubiquity approaching universality of devices for digital reading. More and more kids of all ages and economic backgrounds have smartphones, tablets, and game devices that can be used to read ebooks.

Changing commercial environments create digital opportunities and they’re being seen in this arena. Our clients at Copyright Clearance Center are working diligently to get content made available to be found within the Smarter Balanced multi-state assessment (one of two multi-state, high-stakes assessments funded through Race to the Top grants from the US Department of Education), which enables the inclusion of that content in assessments that could lead to years of discovery by teachers and adoption by schools. (The assessment tool requires the student — for example — to read a poem or a passage. In order to use that assessment, the poem or passage would have to be licensed.) Another initiative we have become aware of is Biblionasium, which is a new community trying to bring together students, teachers, and parents around kids reading.

(Biblionasium helped us make a great discovery. They published recommended reading from each of their three constituencies. We noticed that only one title was in the top three recommendations for all three groups: students, teachers, and parents. The book is called “Wonder” and it is extraordinary. It seems to be written for pre-teens, but I couldn’t put it down. The world will be a better place if every kid reads this book whenever their skill level permits. It has a simple stated moral: “be kinder than necessary”. And it delivers it very persuasively.)

Amazon took a stab at a school marketplace play two years ago, trying to make it easy to enable teachers to load ebooks on Kindles across a class and then “taking them off” when the class was over.

That’s a nod toward a solution, but it falls far short. Teachers need tools and capabilities in and around the content and in and around its consumption that even go beyond what a parent needs to monitor a kid. And, regardless of what the platform can do, there’s still a pricing problem. Although publishers would like to get full ebook prices for every single copy placed on each new student’s device, that can’t work for schools. Buying books is cash-demanding enough, but at least the books can be reused by class after class, semester after semester, until each copy wears out.

Enter Curriculet, whose co-founder, Jason Singer, visited our office last week.

Singer has been a teacher and KIPP charter school administrator. He has designed the Curriculet platform for leading a class through reading a book (or anything else) that gives students additional information and help right in line with their reading. Curriculet also gives teachers both the ability to add direction (quizzes, videos) and to monitor what their kids are doing. The enhancements a teacher adds to text are the “curriculets”; there can be one or many for any book or piece of content.

Speaking as an educator, Singer told me something in our meeting that startled me. Apparently, among 5th grade kids, 75 percent do a chunk of pleasure reading at least twice a week. By 12th grade, that number has dropped to 20 percent. So we lose two-thirds of the kids who are pleasure readers over the course of their junior high and high school educations. This is not only a great failure of our educational system, it is a big loss to publishers. They have an enormous collective interest in collaborating with schools in every way they can to make their books available in an environment where kids will be encouraged to read and enjoy them.

But, again, we come back to the challenges of book prices and school budgets. Singer told us a story about a teacher who wanted to teach “Extremely Loud and Incredibly Close” on the 10th anniversary of September 11, 2001. But buying 150 copies of the printed book was a non-starter. Schools can’t afford to make that investment except in books that they are absolutely confident will be taught year after year. So the same books continue to be taught. Each year they replace some fraction of the copies of “Scarlet Letter” or “Huckleberry Finn” that have worn out, but they never have to replace them all. And they know each new teacher will be comfortable teaching those books. So they continue and, as Singer explained, that’s why today’s kids read many of the same books in school that their parents and grandparents read.

So far, the digital book business for schools has only really been penetrable by companies with enough content of their own to make a license make sense, namely Pearson and McGraw-Hill. Because Penguin Random House is about half the trade market, they could conceivably do the same as ebook use matures. But just about everybody else depends on aggregators to deliver a selection of books large enough to make it make sense for a school district (let alone a classroom) to purchase a license. Consensus around trading terms for ebooks in schools has been slow to develop because of the fear publishers have that the digital copies in such a community setting (loaded with smart kids who might be aspiring — or extremely capable — hackers) could be dangerous to the future sales of that title in digital form.

But at the same time that Curriculet is offering a big advantage to the teachers with the capabilities of its platform, it also offers great comfort to the publishers whose ebooks it wants to use. Part of publishers’ motivation in charging standard (or even higher) prices to schools than to individuals is the (misplaced or not) fear of rampant piracy. Aside from the danger of them being hacked and broadly distributed, they could end up on a kid’s device for lifetime use even if they aren’t spread around.

None of these problems arise with the Curriculet platform. The book lives there; it isn’t taken off it. The student can read it as long as Curriculet allows them to read it; beyond that, they can’t. So publishers can be a bit more adventurous about what they allow into the platform and about the pricing models they explore. The good news for them is that teachers will be convening on Curriculet to share data and teaching insights; there’s a good chance they’ll be telling each other about books and sharing the teaching materials they’ve developed around the books (so they can find things the way I found “Wonder”). That means publishers will find being on Curriculet provides marketing impetus for a book. The better news is that the resulting discovery will turn into sales, not pass-alongs, because access to the content is controlled through the platform.

It’s a long way from a reality because Curriculet, now in beta, will only really hit the market later this spring. But this is a helpful development for schools and for publishers and it, or something like it, is promising for the future of publishers’ revenues from the school market.