New Models

The establishment seems very unworried about being toppled by indies, and 5 other learnings


Programming Digital Book World and the kind of consulting we do require that we spend a lot of time in our office trying to figure out what the industry should be thinking more about. On that topic, there was this recent post with my thoughts about what should be top-of-mind for publishers these days  as well as others laying out topics for next March’s Digital Book World.

A recent DBW agenda planning meeting, which had participation from most of the ten biggest trade publishers, some literary agents, and service providers ranging from marketing services to digital distribution providers, yielded a lode of really interesting ideas that we’re going to act on.

1. One thing that came through loud and clear was big publishing’s interest in hearing how books fit in the greater landscape of digital change. They want to hear from curators of other media and online retailers from other businesses about how they learn about their customers, position a variety of products, and work with search and social media.

2. One participant, whose business provides digital sales data and analytics to a variety of clients, posited that there are four “stages” of behavior that we want to watch around consumer interaction with books. His paradigm is that we want to know:

How they find out about the book
How they purchase the book
How they read, or navigate, the book
How they talk about the book

All of these things are visible in the digital world and this was a helpful frame. In a conversation with my Logical Marketing partner Pete McCarthy afterwards, we reckoned this could elide a very important component: how you get from “find” to “purchase”. That’s what Pete would call “middle of the funnel” or “in the funnel” activity.

In fact, a great deal of what is important about understanding and influencing customer behavior occurs in the middle of the funnel. One of the tempting fallacies of analyzing digital purchase behavior is “last click attribution” of sales. That is, just because the cash register rang in a particular place doesn’t prove that the customer was sold on the book there. Publishers want to concentrate marketing efforts where the decision is made, not necessarily where the transaction occurs. And, in fact, we’re figuring that as time goes by, more and more ebook readers will buy on the particular platform they most favor regardless of where they learned about the book. So there is a fifth activity — how they get from knowledge to purchase — which could be called “the consideration phase” which needs to be thought about separately. This was a very helpful paradigm for understanding customers that will find its way to the program.

3. A very smart independent publisher in the room said “we need a new industry conversation about apps”. When the iPad first happened, quite a few publishers lost quite a bit of money trying to build and sell ebooks as apps. The merchandising environment was all wrong, including that so many apps are free or cheap. But apps can do things ebooks cannot, and they provide a method for ongoing communication with a user, if they use the app. So I think that publisher is probably right.

4. I brought up a complaint I had picked up from a major publisher in the UK. This CEO thought that getting publishers to cooperate around marketing an author when they shared the author’s output was very hard. But the gang I had in the room for the DBW meeting didn’t agree. Big publishers felt that marketing cooperation when one publisher had part of an author’s list and another had another part was entirely possible. And that it was being done. With the help of agents, we’re going to look for instances of that and try to get a DBW panel put together on it. It begs a lot of “next questions” about ownership and allocation of marketing efforts on the author’s website and the use of mailing lists that might be developed through those marketing efforts.

5. Another topic that came out of the meeting was sparked by a discussion of TBR (to-be-read) lists. As one publisher put it, that used to be the stack of books on your bedside table. We were well aware for a few years that January was a very hot month for ebook sales because people got new devices (often, their first device for ereading) for Christmas and were “loading up” in January. But with fewer and fewer readers — particularly heavy readers — now getting “new devices”, that phenomenon (which one participant identified as a close cousin to the sales growth publishers saw 20 years ago when new big box bookstores were opening regularly: “filling the pipeline”) has perhaps waned, or even ended. Understanding how much of what ebook readers buy they read, how much they have sitting on their devices, and whether what is “bought and not read” tends to be low-priced, are all things that should be find-outable and worth knowing.

6. I’d be a lousy blogger if I didn’t save best — or most proactive — for last (except in the post titling, of course). I told the assembled group that I wanted to do a panel on “the future for indie- and self-publishing.” There was remarkably little interest in the subject from those in the room. One literary agent said, “four years ago, indie publishing had us quaking in our boots. We really wondered whether our whole business model would be upended. We don’t worry about that anymore.” Another said “we counsel our authors about self-publishing, but there is less interest in it and less of a rush to it than there was a couple of years ago.” The publishers were similarly relaxed about whatever “competition” self-publishing offers.

So, from the perspective of the publishing establishment, the whirlwind of change has slowed down, we are in a “new normal” and there is absolutely no shortage of writers pining to be published for the deals the industry is offering and the output from those willing writers continue to deliver sales that keep big trade companies profitable. If self-publishing is constituting some mortal threat to everybody’s existence, that appears less evident today than it did a few years ago. And, of course, every big publisher is set for the next X years (unknown numbers that might be different for every big publisher, but almost certainly three or more for all of them) with their single biggest intermediary relationship since they’ve all just done deals with Amazon. One big variable in their commercial calculus that had been highly problematic in the recent past is now stable for a while into the future.

I’ve been making the case that the trade publishing establishment is not in any danger of disappearing anytime soon but the indie world still seems to harbor a fervent contrary belief, which is completely evident in the comment string of the linked post.

The question, “is indie publishing an imminent threat to the establishment?” is one where there is great but contradicting certainty on the two sides of the debate. It looks like the establishment side has largely lost interest in the discussion. I’d love to see if we could “prove” something at Digital Book World, but with so much of the relevant data entirely within the walls of Amazon, which has no apparent interest in sharing it (nor can I make the case that they should), that might be very hard to do.

We are still very much interested in feedback from readers about the topics for the DBW Conference. Feel free to chime in here. And if you have thoughts to contribute about the program for Publishers Launch Kids, that survey is here. If it would be easier for you to just email suggestions, send them to [email protected]

36 Comments »

Things to discuss


The planning process for the main Digital Book World program — about 40 discrete programming elements using about 150 speakers over two days — has always benefited from a “Conference Council” brainstorming meeting. This year’s iteration is later this week. We’ll have attendees from all of the Big Five, several other publishers, agents, and assorted industry players who can help us understand the concerns and initiatives across the waterfront of industry interest.

Sometime after we started doing this in 2009, we added a pre-meeting survey component, asking our Council members to register their opinion about the topics we knew we wanted to consider. That survey was primarily a tool to guide the very fast-moving conversation we have at the Council meeting.

This year we have added a “public” version of the survey. That turned out to be a really good idea. This post is a list of programming ideas that either came directly from the public survey or were inspired by suggestions made there which are very likely to become important parts of Digital Book World 2016.

I’m excited about the idea of doing an entire track on “Making Investments Pay Off”, which is a persistent concern in the world we live in where new business models and new initiatives are being tested all the time. After years with basically the same business model and workflow, publishers are trying new things all the time now without knowing exactly how to make them commercially beneficial. We can see at least four areas where publishers are putting in a lot of effort, but could probably benefit from a discussion about how to measure, monetize, and manage their efforts.

End-user databases (collecting names)
Digital marketing campaigns (publishers are hiring the talent; now, how to make effective use of it)
Building author brands (aligning interests; knowing what you want; making it pay)
Research (it is cheaper and more effective than ever, but how does it pay off)

With all the discussion that persistently takes place around how much of a threat self-publishing does or doesn’t constitute to the establishment (a conversation into which I waded last week), we should host a discussion on the future of self-publishing. I know I’d want Amazon on such a panel, if they’d join. Some other players who could shed light on self-publishing’s future are Kobo, Smashwords, Ingram, a literary agent, and a self-published authors. (This panel has Jane Friedman’s name written all over it as the moderator!)

We’ve never convened a panel of Human Resources people to discuss how what they look for has changed across job functions. That would be an interesting discussion.

With all the new topics, ideas, and startups that seem to arrive on a daily basis, big companies must exercise discipline around what to spend time on and what to avoid. That’s another topic that could be a very important one, if we can find executives willing to speak to it. What are the rabbit holes? What are the things a company should not spend time discussing or exploring in the current environment?

As publishers adjust to a commercial environment where intermediaries are more problematic (partly because they become fewer in number and partly because those that remain become increasingly powerful) but direct sales opportunities become easier to develop and manage, new things are possible. Publishers can now develop online courses and proprietary subscriptions, if they have the right content for them. Tools — like Aer.io — are being put in place for them to sell digital content or hard goods direct with minimal investments in tech. Two publishers, Sourcebooks with “Put Me In the Story”, and Quarto with “This is Your Cookbook”, have recently created custom book lines — using technology to personalize existing content —  that are largely made possible by direct selling. Direct selling is a leading edge of change that enables product types and customer relationships that would never have been possible in the past. More and more publishers will want to know what’s being done and how it might apply to them.

And as the far-flung world becomes reachable from anywhere, English-language publishers in each English territory have unprecedented capability to sell to all the other territories. Getting the Most out of the English-Speaking World — what you need to do, or do differently, to optimize sales in US, UK, Australia, S Africa, India, etc. — is now a topic that just about every English-language publisher can benefit from.

All my readers are invited to participate in the DBW topic survey. Thanks to all of you who have already contributed your thoughts and ideas. As you can see, we’re paying attention.

No Comments »

The publishing business as we have known it is not going away anytime soon


Regular readers, please pardon me for the unusual length of this post, but it covers a lot of ground that I think is necessary to make the point.

A friend who has actually been working fulltime in the book business since I was still in college and who remains active was speculating at BEA about the “next big disruption” in our business. He’s expecting it sometime pretty soon.

I don’t think I am.

Gareth Cuddy is one of the most practical service providers in the industry. His Vearsa ebook distribution company is providing global services to publishers large and small and he is a pioneer in reading and sales analytics. He recently wrote a piece that concludes “whatever emerges from this next phase will surely be a complete departure from what we understand today as an industry” with timetables around it wondering whether 2016 will be too late to respond and whether we’ll have an unrecognizable industry in 2020.

I don’t see it.

One of the disruptor-authors, one who studies the industry trends closely with special attention to indie author growth, told me he “is pegging 2019 as the year that major media outlets cover the collapse of the major publishing houses the same way they started reporting on newspaper declines last decade”.

I wouldn’t be surprised to see a merger or two by then, but “collapse”? I don’t see that either.

The industry has a myriad of sales stats that are not rationalized in any way and don’t talk to each other:

BookScan (print sales, reported by select retailers)

BookScan data is compiled from reports of print sales by most, but not all, retailers. That data includes all the ISBNs (but perhaps not retailer- or indie-published books that don’t have ISBNs), but not all the sales. BookScan covers an estimated 85% of the print retail market in the US and 90% in the UK. (See the “About Nielsen Book” section.)

PubTrack Digital (ebook sales, reported by select publishers)

The PubTrack Digital data, compiled from reports by publishers, doesn’t include all the ISBNs — only those from reporting publishers — but they do include all the sales of those publishers’ ebooks.

AAP (cross-format sales, reported by select publishers)

The AAP tracks sales across all major channels and formats. Like PubTrack, AAP stats are based on reports by participating publishers. (Though all of the Big Five houses report in both cases, other publisher and distributor participation varies.)

Consumer survey data (purchases, attitudes, and behaviors, reported by consumers)

Market research firms and consumer panel surveys (Nielsen Market ResearchCodex Group, and PlayCollective among others) provide another look at how book sales are shifting.

Other survey data

Additional surveys, particularly of authors (e.g. DBW’s author surveyHarry Bingham and Jane Friedman’s author survey) help fill in some of the blanks. But as the survey organizers frequently note, these are not representative samples, so the conclusions that can be drawn from these surveys are limited and primarily directional in nature.

Proprietary data (publisher and retailer-specific)

We also get regular reports from publicly-traded companies and whatever data accounts happen to reveal to the public, which can provide useful benchmarks and comparison points. (The sales data from the accounts themselves includes self-published or retailer-published books that other two sources don’t, but no by-book sales numbers told to the public.)

Bestseller lists and scraped data

Author Earnings tries to translate ebook sales rankings (which are publicly visible at retail, and therefore “scrapeable”) into actual sales numbers. (The now defunct DBW Ebook Bestseller List, powered by Dan Lubart’s Iobyte Solutions, was based on similar principles.) And the major bestsellers lists (like USA Today and NYT) provide at least some context for relative sales performance.

And as a sign of how complicated it all is, the DBW Ebook Bestseller List was discontinued at least partly because the “noise” from Amazon reporting “sales” on ebooks distributed and read through their subscription service was making the bestseller status of many titles a bit contentious.

Despite and because of all the sources, the data is incomplete and scattered. There is inevitable ambiguity in interpretation so that a variety of conclusions can be reasonably drawn. From the big publisher perspective, it would appear that sales are about flat and that the ratio of print and digital sales has become pretty stable. This is true in an environment where publishers have experimented with even higher ebook prices and, for a variety of contractual and commercial reasons, discounting of ebooks has diminished. But that’s been true for a relatively short period of time, and the ebook reporting is routinely delayed by three months, so we don’t have enough evidence to know for sure that higher ebook prices are sustainable in this marketplace. And even if they are sustainable today, that doesn’t prove they will be in three months or a year.

On the print side, Amazon continues to be the largest single customer for almost every publisher. And even though they have managed to increase their discounts and various marketing fees and their returns have creeped up, they are still the most profitable large account for many, if not most, publishers. Since Borders went down several years ago, Amazon has, indeed, grown, but independent stores have also thrived and become more numerous. And although Barnes & Noble still slowly shrinks in sales, it remains the most important account for “breaking” many new titles and still provides more sales to most publishers than all the indie bookstores combined.

While I’ve been working on this piece, the AAP data has been being worked through. Nate Hoffelder (whose blog has been renamed “Ink, Bits, and Pixels”) scoffed at the Nielsen claim that their hard numbers constitute 85 percent of the book market. The AAP, which like Author Earnings, uses modeling and guesstimating to get from the data they have to a bigger industry picture, sees a much bigger trade industry. The point Nate wanted to make, using the AAP data (echoed by an indie author friend of mine who believes that the indies are toppling the establishment and we’d all know that if we knew the “real” numbers that didn’t leave out all the indie success stories) is that the ebook market is not shrinking or flattening.

But if you want to use AAP figures to prove that point you have to use this year’s AAP data. Because last year the AAP said the ebook market had shrunk. By the way, the AAP data was the first to offer some insight on how much ebook subscription offerings are changing the market. The answer, so far, is not very much so far. They account for about 2 million ebook units out of a market of 500 million!

I asked my knowledgeable indie author friend what he thought the consumer dollar volume was for indies last year. He reckoned it at $459 million (I love the presumption of precision: not $450 million or $475 million, but $459 million!) Since the AAP figures adult trade fiction and non-fiction at about $10 billion (and the juvie numbers, another $5 billion, actually have some big “adult” sales in them), he is implicitly acknowledging (but would never say explicitly) that indies are 5 percent of the adult business at retail, using what I’m sure is the most ambitious estimate of indie sales you’ll see anywhere.

The reality is that the business has been actually pretty stable for the past few years, after a period — about 2008 to 2012 — when the shifts away from print and from stores were dizzying and immediately disruptive.

That’s not to say we haven’t seen a lot of change or that change doesn’t continue to be much faster than it was in the period before 2008. But not all of that change is bad for publishers.

More sales at Amazon, less inventory in the physical store supply chain, more ebooks, and the outsized impact of ebooks on the inefficient mass market channel means that returns are lower and less capital is tied up in inventory, which makes publishers more profitable.

The promise that offshore markets can be reached efficiently with ebooks (which, indeed, might be masking a reduction in ebook sales domestically in the overall publisher-reported numbers) is increasingly being realized, partly through the growth in capabilities of the service offerings from old standbys like Ingram and new entrants like Cuddy’s Vearsa.

New tools and workflows are enabling publishers to package their content for both print and digital delivery much more efficiently than they did when ebooks were in their infancy.

Techniques that make it possible for books to be “discovered” through online means — search, social referrals, and growing book- and topic-based communities — are being mastered by publishers.

And a number of factors — consolidation of the accounts, more efficient wholesalers, consolidation of the publishers’ shipping through growing distributors — have reduced costs on the back end for most publishers as well.

So the publishers have, thus far, dealt with massive changes in sales, marketing, and distribution pretty effectively. They’re selling as many books as they used to despite growing competition from both indie authors (a million titles a year or more) and from Amazon itself, whose own publishing operation reportedly intends to issue 2,000 titles in 2016.

Trying to view things from the author perspective requires one to divide them into at least three big “buckets”: successful authors who know where their next totally-acceptable contract that pays them a living wage in advance to write a book is coming from; aspiring authors who either can’t get an agent or a deal or have decided that with self-publishing working as it does that they simply don’t want one; and the ones in the middle, who might have an agent or have had a deal or two, but aren’t really making a commercial success of authorship.

For those authors who find it hard or impossible to get an agent or a deal, self-publishing is a godsend. It gives them a way to really reach the global public at minimal cost and, as we’ve seen repeatedly over the past decade, they can, indeed, break through and achieve commercial success. This is only a good thing for everybody. Even publishers benefit because they get to discover new talent that is surfaced by self-publishing.

For those authors who are working steadily and profitably for publishers, self-publishing has offered the possibility of greater control and bigger margins: more profit if they can achieve the same level of sale. This is not an opportunity very many authors in this category have pursued. That has surprised me a little bit, but probably it shouldn’t have. Being a publisher is a lot of work and no small risk. If an author is making a living doing the writing and letting a publisher handle the rest, that’s damn near nirvana. Very few in that position want to abandon it.

So that leaves the authors “in the middle”: getting deals or capable of getting deals, but not really making the living they want to make with those deals. Among those authors, if they have the skills to manage an enterprise and the personality to put themselves out there for promotion, self-publishing offers a real alternative to the legacy system. Particularly for those authors who have a backlist they can claw back rights to and use as a foundation for their efforts, this new opportunity has real possibilities.

And writing in genres, being able to deliver several books a year, and writing in a way that allows pieces of big books to “work” as self-contained smaller chunks, are all attributes that enhance the likelihood of self-publishing success. It is worth noting that, so far, publishers haven’t developed the techniques to make the most effective use of chunked stories or a voluminous output (unless you’re James Patterson!).

So another source of potential disruption — authors abandoning publishers to do it themselves to make more money per unit and claim greater control of their work and career — has also not really happened. I was among those who expected, during the era of dizzying change we experienced for a few years until a couple of years ago, that publishers could have a big problem holding on to their biggest stars.

Both the supply (authors) and demand (sales channels) sides of the equation appear more stable than they’ve been in recent memory. But there’s no guarantee they’ll stay that way. The number of self-published titles keep growing by a million titles a year or more. They sell a paltry average per title, and a very small percentage sell a measurable amount at all, but cumulatively, their sales add up. Most of the revenue from that growing market segment goes to Amazon and a very small share of it goes to print or brick-and-mortar. Amazon’s growth in any way fuels their ability to be tough on terms, reducing publishers’ margins. (One big potential wild card is Amazon’s pressuring publishers to allow them to manufacture more and more of the inventory; that could be a paradigm-shifter if they succeed in making it widespread.) And more ebooks, particularly indie ebooks, and the subscription services for ebooks also tend to force down retail prices, which puts further pressure on publishers’ margins.

One other source of potential disruption — and this is one that I think many have in mind when they predict real danger for the establishment is around the next bend — would be some sort of disruptive product innovation. What if book readers suddenly demand video in books, or that stories be turned into games, or that books be enhanced by the margin notes made by prior readers? Would today’s publishers be able to compete? What would that do to margins?

There are areas of publishing outside trade where the “book” has either already become obsolete or could well be in a few years. As we have pointed out repeatedly over the years, ebooks have only really “worked” as substitutes for print books that one reads from beginning to end, narrative reading. The additional “functionality” that might be employed, such as those described above, has been pretty consistently and over a long period of time rejected — or, at least, not widely embraced — by the book-reading public.

But that’s not true in professional publishing, where books have often already been replaced by websites, online tutorials, and other uses of digital interactivity. (John Wiley, one of the biggest professional and trade publishers in the world, is largely exiting the business of “books”. O’Reilly Safari demonstrated over a decade ago that a subscription service was a great commercial proposition for professional books, long before it was even tried for consumer.) It is likely not to remain true in school and college textbook publishing, where the value of integrating testing and then adjusting what’s presented in the content delivery has enormous value and where institutions, rather than individual consumers, are in control. Predicting big disruption in these markets over the next few years seems like a much safer bet than in trade. Of course, those parts of the trade markets that look similar to those — cookbooks and travel in particular — have already seen wide-scale disruption.

Frequently, those who say they’re expecting disruptive change also promote the expectation that there will be some really substantial shift in consumer behavior. Quoting Cuddy:

So what is a book? What is reading? How will the millennials and children of the future consume stories? Will they even want to? I don’t think any of us know.

This is the big bugaboo: the death of long-form reading. That’s a reasonable thing to conjecture about, but not in the next three years or five years or even ten. In 2025, most of the books being read on the planet will be read by people who are reading them now. The most recent serious study about “designing books for millennials” (from Publishing Technology) seemed to conclude that millennials aren’t much different than the generations that preceded them when it comes to their book-reading habits.

Over the long run, things will almost certainly change in very big ways because of the inexorable forces eroding publisher margins described above. I wouldn’t be surprised to see only two or three big trade publishers as soon as ten years from now. I’d expect that the two recent plateaus we’ve reached, with ebook sales stabilizing in relation to print and with bookstores holding their own, will prove temporary. I wouldn’t expect ebook sales or online purchasing to grow by the leaps and bounds they did a few years ago, but it would surprise me if we’ve reached any long-term limit, particularly in ebook use. (The devices keep proliferating and people get increasingly comfortable reading for a long time on screens.)

More and more entities of all kinds will be using books, and particularly ebooks, to further their own missions through education or content marketing. They may not “flood” the market, but they’ll add a lot of product not necessarily priced with commercial intent that will steal sales and reader time from what publishers are trying to peddle.

For some time, I have figured that book reading might grow but that the industry that delivers books for profit might shrink. That would still be my expectation.

The biggest threat to publishers as we have known them would be consolidation among the intermediaries who sell their books. My hunch today would be that Amazon sells more than 40 percent of the books in the US. Indeed, their own publishing operation is growing despite the fact that they face continued resistance from their competing retailers to carrying their books. That suggests that books can be profitable, and authors made happy, on sales made to the Amazon audience alone. The bigger their share gets, the more that presents a real danger to publishers.

The whole point of publishers is “many to many”. They handle the output of multiple authors to give them the scale necessary to provide services to multiple sources of revenue for both books and rights. Amazon consolidated a big enough share of the audience that what they alone could sell constituted a viable market. That, combined with the elimination of inventory investment enabled by ebooks, created a robust indie publishing business. (Yes: iBooks and Nook and Google and Smashwords and others are part of it, but Amazon created it, and it might not be much of anything yet if they hadn’t!) Amazon could afford to pay a higher share of the consumer price than any publisher selling through them could and that created the marketplace in which indie authors could thrive financially and have a logical basis to express incredulity that other authors would take a publisher’s deal. During the days when both Amazon’s share and the ebook market were growing without any obvious limits, predicting that they would one day soon put a bullet in the heart of the publishing business might have been an overambitious projection, but it wasn’t entirely illogical.

But those days have passed. In retrospect, the big threat to publishers probably ended when Larry Kirshbaum’s efforts to get big name mainstream authors to leave legacy publishing in some numbers for Amazon failed, largely (I’d conjecture, we’ll never really know) because the competing retailers refused to play ball. Their outspoken refusal to carry Amazon books escalated the risk to an author’s career if they took any amount of money to be Amazon-published. That was not necessarily a deal-killer to a genre author who could reach a big share of their market with Amazon alone, but it made it just about impossible for Kirshbaum (or anybody else who might have occupied that seat) to use a checkbook to persuade an author already successful with legacy publishers to, essentially, risk their career.

Since then, despite Amazon Publishing’s continued growth (primarily in genres, not general trade) and what appears to be the continued growth in self-publishing have not really threatened the legacy publishing business. As long as the big authors don’t abandon the publishers, they’re safe. And as long as there is a complex demand chain for publishers to manage and service to pull in the revenue, they probably won’t.

So figuring out whether or when the industry turns upside down depends on figuring out whether or when the demand consolidates at Amazon to such an extent that the rest of the market can be lived without.

There will be fewer bookstores. There will be more titles competing from outside the commercial publishers. There will be continued downward pressure on prices. There will be diminishing interest in having a narrative book in printed form. And despite publishers’ efforts to add value by reaching distant markets and learning how to do digital marketing at scale, the publishing industry will, indeed, shrink.

But an apocalypse is probably not around the corner. And the book business as we see it today will still be recognizable in 2020 and even in 2025. I suspect that the business environments for all other media — music, movies, TV, and games — will change more than the business for narrative trade books over the next ten years.

Remember that we are conducting two surveys of industry opinion to inform the programming we’re doing for next March. Click here if you want to express yourself on the topics for Digital Book World 2016 and here if you want to register opinions on the program ideas for Publishers Launch Kids. 

38 Comments »

Market research used to be a silly idea for publishers but it is not anymore


When my father, Leonard Shatzkin, was appointed Director of Research at Doubleday in the 1950s, it was a deliberate attempt to give him license to use analytical techniques to affect how business was done across the company. He had started out heading up manufacturing, with a real focus on streamlining the number of trim sizes the company manufactured. (They were way ahead of their time doing that. Pete McCarthy has told me about the heroic work Andrew Weber and his colleagues did at Random House doing the same thing in the last decade, about a half-century later!)

Len Shatzkin soon thereafter was using statistical techniques to predict pre-publication orders from the earliest ones received (there were far fewer major accounts back then so the pre-pub orders lacked the few sizable big pieces that comprise a huge chunk of the total today) to enable timely and efficient first printings. Later he took a statistically-based approach to figure out how many sales reps Doubleday needed and how to organize their territories. When the Dolphin Books paperback imprint was created (a commercial imprint to join the more academic Anchor Books line created a few years before by Jason Epstein), research and analytical techniques were used to decide which public domain classics to do first.

In the many years I’ve been around the book business, I have often heard experts from other businesses decry the lack of “market research” done by publishers. In any other business (recorded music might be an exception), market research is a prerequisite to launching any new product. Movies use it. Hotel chains use it. Clothing manufacturers use it. Software companies use it. Online “content producers” use it. Sports teams use it. Politicians use it. It is just considered common sense in most businesses to acquire some basic understandings of the market you’re launching a new product into before you craft messages, select media, and target consumers.

In the past, I’ve defended the lack of consumer market research by publishers. For one thing, publishers (until very recently) didn’t “touch” consumers. Their interaction was with intermediaries who did. The focus for publishers was on the trade, not the reader, and the trade was “known” without research. To the extent that research was necessary, it was accomplished by phone calls to key players in the trade. The national chain buyer’s opinion of the market was the market research that mattered. If the publisher “knew different”, it wouldn’t do them any good if the gatekeeper wouldn’t allow the publisher’s books on his shelves.

And there were other structural impediments to applying what worked for other consumer items. Publishers did lots of books; the market for each one was both small and largely unique. The top line revenue expected for most titles was tiny by other consumer good standards. The idea of funding any meaningful market research for the output of a general trade publisher was both inappropriate and impractical.

But over the past 20 years, because a very large percentage of the book business’s transaction base has moved online and an even larger part of book awareness has as well, consumers have also been leaving lots of bread crumbs in plain digital sight. So two things have shifted which really change everything.

Publishers are addressing the reader directly through publisher, book, and author websites; through social media, advertising, and direct marketing; and through their copy — whether or not they explicitly acknowledge that fact — because the publisher’s copy ends up being returned as a search result to many relevant queries.

The audience research itself is now much more accessible than it ever was: cheaper and easier to do in ways that are cost-effective and really could not be imagined as recently as ten years ago.

We’ve reached a point where no marketing copy for any book should be written without audience research having been done first. But no publisher is equipped to do that across the board. They don’t have the bodies; they don’t have the skill sets; and a process enabling that research doesn’t fit the current workflow and toolset.

So when the criticism was offered that publishers should be doing “market research” before 2005, just making that observation demonstrated a failure of understanding about the book business. But that changed in the past 10 years. Not recognizing the value of it now demonstrates a failure to understand how much the book business has changed.

What publishers need to do is to recognize “research” as a necessary activity, which, like Len Shatzkin’s work at Doubleday in the 1950s, needs to cut across functional lines. Publishers are moving in that direction, but mostly in a piecemeal way. One head of house pointed us to the fact that they’ve hired a data scientist for their team. We’ve seen new appointments with the word “audience” in their title or job description, as well as “consumer”, “data”, “analytics”, and “insight”, but “research” — while it does sometimes appear — is too often notable by its absence in the explicit description of their role.

Audience-centric research calls for a combination of an objective data-driven approach, the ability to use a large number of listening and analytical tools, and a methodology that examines keywords, terms, and topics looking to achieve particular goals or objectives. A similar frame of mind is required to perform other research tasks needed today: understanding the effect of price changes, or how the markets online and for brick stores vary by title or genre, or what impact digital promotion has on store sales.

The instincts to hire data scientists and to make the “audience” somebody’s job are good ones, but without changing the existing workflows around descriptive copy creation, they are practices that might create more distraction than enlightenment. Publishers need to develop the capability to understand what questions need to be asked and what insights need to be gained craft copy that will accomplish specific goals with identified audiences.

Perhaps they are moving faster on this in the UK than we are in the US. One high-ranking executive in a major house who has worked on both sides of the Atlantic told me a story of research the Audience Insight group at his house delivered that had significant impact. They wanted to sign a “celebrity” author. Research showed that the dedication of this author’s fans was not as large as they anticipated, but that there was among them a high degree of belief and faith in the author’s opinions about food. A food-oriented book by that author was the approach taken and a bestseller was the result. This is a great example of how useful research can be, but even this particular big company doesn’t have the same infrastructure to do this work on the west side of the Atlantic.

What most distinguishes our approach at Logical Marketing from other digital marketing agencies and from most publishers’ own efforts is our emphasis on research. We’ve seen clearly that it helps target markets more effectively, even if you don’t write the book to specs suggested by the research. But it also helps our clients skip the pain and cost of strategic assumptions or tactics that are highly unlikely to pay off: such as avoiding the attempt to compete on search terms a book could never rank high for; recognizing in advance a YouTube or Pinterest audience that might be large, but will be hard or impossible to convert to book sales; or trying to capture the sales directly from prospects that would be much more likely to convert through Amazon.

With the very high failure rate and enormous staff time suck that digital marketing campaigns are known for, research that avoids predictable failures pays for itself quickly in wasted effort not expended.

McCarthy tells me from his in-house experience that marketers — especially less-senior marketers — often know they’re working on a campaign that in all probability won’t work. We believe publishers often go through with these to show the agent and author — and sometimes their own editor — that they’re “trying” and that they are “supporting the book”. But good research is also something that can be shown to authors and agents to impress them, particularly in the months and years still left when not everybody will be doing it (and the further months and years when not everybody will be doing it well.) Good research will avoid inglorious failures as well as point to more likely paths to success.

Structural changes can happen in organic ways. Len Shatzkin became Director of Research at Doubleday by getting the budget to hire a mathematician (the term “data scientist” didn’t exist in 1953), using statistical knowledge to solve one problem (predicting advance sales from a small percentage of the orders), and then building on the company’s increasing recognition that analytical research “worked”.

If the research function were acknowledged at every publisher, it would be usefully employed to inform acquisition decisions (whether to bring in a title and how much it is worth), list development, pricing, backlist marketing strategies, physical book laydowns to retailers, geographical emphasis in marketing, and the timing of paperback edition release.

Perhaps the Director of Research — with a department that serves the whole publishing company — is an idea whose time has come again.

But, in the meantime, Logical Marketing can help.

Remember, you can help us choose the topics for Digital Book World 2016 by responding to our survey at this link.

4 Comments »

Considering the very wide range of digital change topics that should be candidates for discussion at DBW 2016


The challenge for the book business for the past decade has been rapid and less-than-predictable changes in the ecosystem because of digital. There are two underlying shifts that fundamentally alter the ecosystem: people substituting ebook consumption for print book consumption and people substituting online purchase of printed books for buying them in stores.

These two shifts, and a host of corollaries around product type, product creation, and marketing, are what people come to Digital Book World to be enlightened about and to discuss. Our job for the past seven years has been planning the program and booking all the speakers for that 3-day conference. The whole process takes months; there are about 35 or 40 discrete “sessions” and as many as 150 speakers and moderators involved.

Creating a timely and relevant program when we’re leading the target by several months — deciding on topics and recruiting speakers starting now for an event that will take place March 7-9, 2016 — is a challenge. More perspectives on the task add real value; we structure things so we can get a lot of help. We recruit a “Conference Council” — volunteers from publishing companies and their service providers and trading partners — to help advise me in shaping the event. This year we’re going to broaden the outreach for opinions about this and anybody reading this blog can be involved.

Here are the main topic headings we’re considering with a brief description of what we see as the current issues around each. The Survey linked to again at the end of this post allows you to express yourself on how important you think each topic will be to the publishing community next March when we hold the conference.

1. Data. This is a wide-ranging topic. We look for original data about what’s going on in the ecosystem wherever we can find it and we have done sessions in the past (and could again) about “Big Data” and what publishers need to understand about it. With pricing of ebooks becoming an increasingly important financial consideration for publishers and data being such a crucial component of doing that well, this is bound to remain a top-of-mind subject.

2. Global. Publishers used to be pretty much limited to their home market for marketing and sales. That’s why there is a robust international business in territorial and language rights. In the digital world, that limitation is not nearly as confining. US and UK publishers are learning there are big markets for their books all over the world, and global ebook distribution and print-on-demand make it possible for them to work those markets far more effectively than ever before from their offices, wherever they are.

3 Marketing and discovery. This is the topic that cuts across books regardless of topic or format. For fiction or art books or anything in between, whether delivered in print or as ebooks, publishers are embarked on a long journey of learning about how discovery and SEO works in the most complicated consumer product marketplace imaginable. There are a variety of topics that we entertain under this heading and, you could tell from my own checklist in my last post, I could probably build the whole conference around discovery and figure the audience was getting a large percentage of what is most important.

4. Authors and self-publishing. Authors didn’t used to have much alternative to publishers; now they do. As a result, authors have developed marketing capabilities and support services have grown up to help them. This all raises a host of issues for publishers. They have to learn how to capitalize effectively on what authors can do on their own, but they also need to provide great marketing support to authors and be seen as collaborative and as adding real marketing value.

5. M&A and investment. Most publishers, and all big publishers, are looking to acquiring smaller publishers with complementary lists (and, of course, there are different ideas about what that means). And there are a host of start-ups with capabilities publishers want to see available which are also tempting investments. Quite aside from publishing, we live in a moment with a lot of investment capital available for start-ups and acquisition and publishers certainly need to stay aware of investment flows.

6. Is the book morphing into something else? With each new cycle of Moore’s law and each new delivery mechanism — whether hardware or platform — the question of what the “product” should be gets called for reconsideration again. The history of ebooks has been commercially discouraging for those who want see the book concept rethought from the ground up, but the topic never dies and never will as long as capabilities to present stories and information and to interact with content in new ways are put in front of publishers.

7. Managing and exploiting rights. The rights marketplace for books has changed dramatically in the past two decades. In the 20th century, book clubs and paperbacks were the big-revenue rights opportunities, with serialization to print periodicals also very important. Those markets are all dramatically diminished and the rights action today mostly is about foreign languages and territories. Now, even those rights are being rethought as we see the beginings of publishers thinking about controlling multiple languages for the books they acquire themselves.

8. Agents and editors, how they relate in a mutually-supportive way. They share ownership of each author’s personal loyalty, they both might shape the book editorially, and they both will hear the author’s career ambitions and influence him or her about self-publishing and their publishers’ efforts. If publishers are going to start collaborating meaningfully with authors about marketing, that suggests agents and editors are going to be working together differently.

9. Libraries. Aside from being important customers for publishers, libraries are increasingly being seen as a venue for discovery and perhaps even for book retailing. Whatever they will be in the future, it is likely their role will be different than what Andrew Carnegie envisioned a century ago.

10. Bookstores. Since the collapse of Borders, Barnes & Noble has continued to shrink and independent bookstores have appeared to grow. Books-a-Million and Walmart have become mainstays of the US trade, but they don’t replace Borders. The UK bookstore picture is even less diverse. The ebook market seems to be consolidating in the US with Amazon and Apple leading the pack and independents not really in the ebook game at all, at least at the moment. The key skill set of a publisher is to manage a diverse system of retail intermediaries that gets their books to customers. How the intermediary ecosystem will change in the months and years to come is therefore of existential importance to publishers.

11. Standards. There are evolving tech standards around content that live outside the book business. The question for publishers, particularly big publishers, is how much effort they should expend on standards-creation efforts which are, mostly, the domain of other media and tech interests. Can they let industry bodies like IDPF and BISG handle this, or do publishers have to involve themselves in these issues?

12. Outsiders coming in. We are seeing publishing coming from non-publishers and we see non-book retailers starting to peddle books online. These are trends that industry incumbents need to monitor and understand.

13. Millennials. Some believe that the human propensity to be a book reader is changing in fundamental ways as people born into the internet age become an increasing part of the market. There are other data points suggesting that the millennials aren’t so different from their predecessors. How should publishers approach marketing differently to different age groups?

14. Digital production tech and operations. Is there already a “new normal” for integrated print and digital publishing? Do publishers need to continue thinking about investing in technology for creation and delivery?

15. Audio. Audio publishing has gone all-downloads much faster than print. An even bigger technological disruptor may be coming as TTS (text-to-speech) technology gets better and better. What the linkage will be between audiobooks and ebooks in the future is something else every publisher needs to consider.

16. Publishing automation. From content management to product generation, automation has been part of every publisher’s life for the past several years. It might be fruitful to explore how people in publishing houses feel about the automation that has taken place — has it helped? — and get a sense of what needs to be automated in the future.

17. Mobile. Because of mobile, there are shifts in consumption and an impact on search and discovery and where the transactions take place. Many publishers have worked to optimize their websites for mobile use but there’s a lot more to know about the mobile shift that could affect what they publish and how they market it.

18. Video. This topic runs a gamut. Publishers can be tempted by YouTube stars with big audiences as potential bestselling authors. But how reliably can those audience be converted to buy books or ebooks? What do publishers need to know about video production? Do videos really help with book marketing?

19. Privacy. Should publishers or booksellers be doing anything to address potential compromises to reader privacy in the digital age?

And then we have six questions for all publishers that could inform or suggest additional topics.

* What growth opportunities do you see for today’s publishers?

* What potential change in the landscape are you most worried about?

* What “problems” are you trying to solve?

* Where are you investing your capital?

* When you hire today, what skills are you looking for that you might not have ten years ago?

* Can you tell us any topic you think is important that isn’t mentioned here?

This link to our survey is intended to allow you to participate in helping us decide what’s important for DBW to cover. Even a program as extensive as ours has to make choices and your input will help us do that more wisely. In case you’re interested, here is my personal list of what publishers should be thinking about, which is a very-much-abridged version of this post.

Under the direction of our Conference Chair, Lorraine Shanley, and co-Chair Jess Johns, we are following a parallel process for our Publishers Launch Kids show which will kick of DBW on March 7. If you are kids book publishing interests you, the survey for that show is here and you’re welcome to participate in that one as well.

8 Comments »

The utility of examining the text of a book to find search terms for SEO


The first two things to understand about optimizing book copy for SEO that I’ve learned from Logical Marketing partner Pete McCarthy are:

1. Copy always used to be written based on “knowledge of the book”. It should now be written based on “research into the audiences”.

2. Copy from publishers was almost always B2B, intended for intermediaries in the marketing and supply chains. Now all copy ends up being B2C, important for consumers and search.

These are tough hurdles for the most established publishers to jump, because executing on the audience research piece not only requires a change in the workflow and distribution of work among staff, doing that also requires additional effort that employs skills that may be in short supply, if they exist in the publishing house at all.

With all that additional work in front of them, any automated solution that can be offered to publishers to diminish the pain of this transition is attractive. (We’re working on a few of those ourselves.) I’ve recently become aware of the new technology offered by Trajectory, which examines a book’s text for words that should be used for SEO.

Automation is good, but this is still coming from within the book. So I asked my Logical Marketing team to help me understand: is this helpful?

The answer seems to be, “it is a positive step but a very partial one. And it does not help anybody avoid the research we think is fundamental.”

The article by Jim Bryant of Trajectory on the Publishing Perspectives blog demonstrating the value of their capability is very clear. He used as one example a book called “The Mayo Clinic Diet”. A word cloud Trajectory created from the book showed clearly that there were two big words, “calorie” and “exercise”, which appeared frequently in the book, were important to its thesis, and were not in the copy the publisher created to describe it. That’s the positive step.

But Logical Marketing methodology is to find out what words the consumer uses to describe what is in the book, particularly in search. With a backlist book, this can be easily researched in Library Thing. The word cloud at Library Thing for this very same book says the terms that the consumers use are “diet” and “dieting” (which, being in the title, were already in the descriptive copy), “cookbook” (not in), “health” and “health and fitness” (not in), “nutrition” (not in), “weight loss” (which was in the original copy; hey! it is a diet book!), and “exercise” (in because it was identified by Trajectory.) “Calorie” apparently didn’t figure as important to the consumers on Library Thing as an associated term.

But going beyond the important terms not in the book and therefore never to be found by the Trajectory methodology, were those other prime terms — “cookbook”, “health”, “health and fitness”, and “nutrition”. And a bit more work on our part also identifies longer-tail terms that will be more important for discovery than what Trajectory found: “healthy diet”, and “lifestyle changes” among them. You get that very clearly from Library Thing.

Pete McCarthy did a post for the DBW blog recently that used “To Kill a Mockingbird” to show why the words that are in the book are not sufficient for first-rate SEO. (Pete used a fiction title because it is often said that fiction is harder to SEO than non-fiction. The point is that the methodology still works.) What is that literary classic about that a semantic examination of the text probably won’t tell you? Racism. Civil rights. It is also important Southern Literature. As an aside, you can combine certain of those tags to find comparable other authors for specific aspects of the book that will resonate with certain customers. You know another author who jumps out with that analysis? John Grisham. Will Trajectory’s method show you that? We don’t think so. They have built sophisticated technology to analyze writing style and story structure, but whether that would connect Harper Lee and Grisham is very doubtful. Using the characterizations of consumers connects them very clearly.

We don’t mean to dismiss Trajectory. We might well learn to incorporate it into our methodology in circumstances where it is available to us (if a publisher we’re working with has it), but almost certainly for new titles only. It is not worthless to examine the text of a book looking for clues to good keywords. But it is a mistake to ignore McCarthy’s first rule: that the descriptive copy that serves you best for SEO requires research into the audience, even gaining knowledge as rudimentary as in the example. Semantic examination of the text automates what we’ve always tried to employ manually: knowledge of the book. That’s useful, but it is really the smallest part of a much larger job to create descriptive copy optimized for search.

To modify an old aphorism, knowledge gained from the text is often unnecessary, but never sufficient.

As for backlist, the important terms that the Trajectory examination uncovered are found much more easily and quickly at Library Thing. The tool that was well-built to begin with, has existed and been iterated upon and had data added to it for years, and been underutilized for a long time because it was seen as a “niche consumer” capability, is still the best one. It is populated with terms used by real people not employed by the author or the publishing house. Its data is not based on transactional history, but on reading history. That’s what you really want for SEO. New titles are a bit harder, and Trajectory over time will likely solve pieces of that puzzle, but audience research is still a lot more important than an examination of the book’s text to achieve the desired result of having readers who are unaware of a book but would be likely to want it have it put in front of them for consideration.

We recollect that Amazon had the full text for many books and used to do a semantic analysis of it. (They certainly still do X-ray in Kindle, which is a version of it.) They haven’t emphasized it and they haven’t built on it. That suggests that the commercial value of it is questionable. And Google also identifies “common words and phrases” and provides a word cloud, which you can see here for “The Mayo Clinic Diet” if you scroll down.

And, indeed, we’re dealing with Trajectory 1.0. Over time they may make their analysis increasingly relevant and useful. But no matter how smart and sophisticated you are, you can’t examine the book itself to find out how people reading it react to it and think about it and that is the information that tells you most about who might read it next.

7 Comments »

Four of the big five have new deals with Amazon and only the biggest is still to negotiate one


A reporter called earlier this week focused on what he figures are the upcoming negotiations over trading terms between Amazon and Penguin Random House. I had observed when Amazon was throwing sharp elbows at Hachette during their contractual dispute that Amazon wouldn’t try similar tactics with PRH.

Since then, with HarperCollins and Amazon having announced they’ve reached new terms, deals have been done with all the Following Four US publishers. It would appear that the DoJ’s and Judge Cote’s work to stop publisher-controlled pricing across retailers has been very largely undone by the deals independently arrived at. So it is a sensible question for a reporter to ask, as this one was: can Penguin Random House do better than the others did in these negotiations?

I don’t know the answer to that. And even after a deal is announced, none of us will necessarily know the answer. But this is an appropriate time to consider the power of Penguin Random House’s position in the marketplace. It is very strong. If I were any of the other four major publishers, I would fear PRH more than Amazon as a potential disruptor of my business. When I put that proposition to a UK-based executive of one of those companies at the London Book Fair last week, he readily agreed with me.

When one considers what a segmented business publishing is, the Penguin Random House combination becomes that much more eye-catching. These five companies — PRH, HarperCollins, Simon & Schuster, Hachette, and Macmillan — compete much more with each other than they do with anybody else. Cambridge competes with Oxford and other university presses. Quarto competes with Chronicle and Abrams and Running Press and outside the US with Egmont and other illustrated book publishers. Yes, a bestseller might come from anywhere: Harry Potter came to the US market from Scholastic and the UK market from Bloomsbury. But the publishers who compete for the bestselling authors and the front-of-store slots repeatedly are the Big Five, which were formerly the Big Six.

And when Penguin merged with Random House, that was not just any old merger of the Big Six. It was a merger between Number One and Number Two. It has created a single company that is, in the US market, about twice the size of its next competitor (about $2.5 billion in sales for PRH against about $1.2 billion for HarperCollins). And HarperCollins, in turn, is about double the size of each of the other three.

What that means is that PRH, like Amazon, can make its commercial decisions independently from the rest of the industry. They can take risks that would be very challenging for anybody else. Amazon could afford to get into a dust-up with Hachette that affected the supply of books in ways its customers could clearly see and make it public to try to make a point. Random House, even before the merger, could afford to stay out of the new iBookstore (they wouldn’t play ball with agency terms in the beginning) for a while, which would have seemed a big risk to the others. (Of course, the DoJ and Judge Cote didn’t see it as individually-discernible risk. Their explanation was “collusion”.) That decision by Random House paid off in big ways in 2010 with higher sales per ebook title (because they didn’t go to agency, which reduced the per-title take) and higher unit sales (because agency would have forbidden discounting, and Amazon went to town discounting Random House books against their agency competitors).

In the past year, Scribd and Oyster announced ebook subscription programs. Pretty quickly, HarperCollins and Simon & Schuster announced varying degrees of participation in the services. And then Macmillan followed. But Penguin Random House and Hachette stayed out. Hachette is the most author- and bestseller-driven of the major houses and author brands are the most likely long run casualties if subscription services succeed. But, if they succeed, Hachette will have to go back to them hat in hand. Penguin Random House won’t, necessarily.

Because if subscriptions are actually the wave of the future and the title rosters from Scribd and Oyster are sufficient to make that happen, then PRH could compete with them entirely on their own. They would have as many prominent commercial books from their own reservoir as the other services have aggregated. And they wouldn’t be sharing with a third party vendor.

It is worth noting that PRH has gone into the Scribd service with audiobooks.

When Oyster announced last month that they would now sell ebooks a la carte as well as in subscription bundles, some of the press saw more significance to the move than it warranted. Scribd started out as an a la carte document access site. Amazon itself formed a subscription service (Kindle Unlimited) the minute Scribd and Oyster announced what they were doing. If you have the capability to sell ebooks, why not sell them by whatever commercial arrangement the customer wants?

By the same token, the distinction between publishers and retailers is melting away. Amazon went into publishing very quickly after ebooks enabled self-publishing. Barnes & Noble published proprietary books for years, even before they bought Sterling in 2002. HarperCollins built a retailing capability for themselves in the past year. (The Tor.com imprint of Macmillan said they’d be selling DRM-free ebooks directly from their own site, but we have seen no evidence that they actually ever did.)

So, the reporter trying to understand the possibly-occurring Amazon-PRH negotiations wondered, would PRH become a retailer?

I don’t think so (at least not anytime soon), but I still believe — as I did when I first speculated about all this 2-1/2 years ago — that a store could have a competitive selection of books with titles exclusively from PRH. No other publisher could serve a general interest audience at retail without other people’s books as well.

How else could PRH be disruptive? They could offer a license to schools for their titles. If a school bought one of those to load its students’ digital devices with content, they wouldn’t have everything they might want but they could conceivably have all they need. How hard would it be to sell a competing license with less good stuff in it? How hard would it be to build an aggregation so that a competing license had as much good stuff in it?

The executives I’ve spoken with at PRH — and I have high personal and professional opinions of all of them — have consistently disclaimed any interest in most of what I’m suggesting. And, indeed, they haven’t started a subscription service and they’ve shown no signs of rolling out a program to create PRH-only bookstores. There are reasons, aside from altruism or short-sightedness, why they might resist these solutions. After all, PRH publishes about half the most commercial titles in the US book trade. Subscription services and retail competition would weaken the existing bookstore network, and PRH benefits from its existence in proportion to its relative size, which is to say “much more than anybody else”.

In fact, I’ve discussed the possibility that they could be so disruptive with the CEOs of two of the other Big Five, and neither executive (unlike the one I met with in London last week) expressed much concern. One said “they don’t want to do that”, meaning “they don’t want to destroy the competition in the trade” (which is a point of view that is actually supported by what the executives at PRH have said to me, as counter-intuitive as it seems). And the other one believes that having PRH in the game to negotiate with Amazon and B&N helps keep the terms of trade in check for everybody else as well. That executive likes having PRH there, with all its size and clout.

I had the conversation with the reporter that was the catalyst for this post on Wednesday morning and it was mostly drafted on Wednesday afternoon. Penguin Random House’s new consumer-centric web site was unveiled Thursday morning and underscores their support of the trade (they’re trying to push sales to retailers, not sell directly themselves). The site appears to give a page for every book they’ve got, which could well prove very useful as they build embellishments.

They refer the sales over to a robust choice of retailers for all formats. One thing I noticed was that a particular ebook I looked for — Napoleon, A Life by Andrew Roberts — is $45 in cloth, $20 in paperback, and the ebook is listed at $29.99! Running through the list of retailers to which PRH links directly, we can see that Amazon and Google Play discount the book down to an identical approximately 14.4% off $25.65 (with Amazon touting the massive saving over the hardcover price!) but the others listed — Apple, B&N Nook, Books-a-Million, and Kobo — offer it at the $29.99 list price. Close observers of the changing state of agency pricing will be watching whether the pricing or the discounting profile changes when PRH concludes that next round of negotiations.

And, incidentally, this also jibes with something we were told very recently by an ex-Nook employee, who said that the DoJ and Judge Cote effectively stopped B&N’s ability to compete with Amazon in its tracks when they opened up discounting of agency. Not only did they strip out margin that B&N desperately needed to compete, competing then effectively required price-monitoring capability to keep up with Amazon that was beyond their capabilities. Google has no problem doing that and maybe nobody else can keep up, but it would take looking at a lot more than one title to prove that.

5 Comments »

Pete McCarthy shows how audience research can be done quickly and efficiently


I keep learning about “marketing today” from Peter McCarthy. There are two first principles about descriptive copy (a part of what is referred to as “metadata”, but a tricky part because, unlike trim size or price, it isn’t always obviously “right” or “wrong”) that all publishers need to take on board and adjust their workflows to accommodate. As far as I can tell, none of any substantial size have.

1. Descriptive copy has always been written by somebody who really knows the book, which often meant an editor (sometimes a marketer) involved with it well before publication. Now the copy needs to be written with knowledge gained through research into the audience. That takes both time and capability that hasn’t previously been required.

2. Descriptive copy has overwhelmingly been intended for a B2B purpose — catalogs and title-information-sheets for accounts — and now all copy, whatever its original intent, is likely to end up being seen by the consumer and, more importantly, it will be influencing the search engines that respond to consumer queries.

This is a change that is difficult for a big company to cope with because of their size. But it is hard for everybody because of the uniqueness of each book compared to others. The research methodologies have to scale on one hand but also be right-sized and tweaked for each book, author, and brand. Books aren’t soap. Knowledge of the book itself is generally limited to the editor(s) involved until they push it out to the rest of the company. So it is natural for editors or their assistants to draft descriptive copy. But these people may not have either the time or the skills for audience research.

But if the audience research is seen as a separate activity that should “feed” the copy-drafting, then the challenges are to figure out who on the team should do it, how they acquire the skills and knowledge of the tools to execute, and — trickiest of all — how to budget for the additional time and effort required (which across a large list is substantial).

And then there’s the problem of making sure the copy is consumer- and search-engine-friendly, which is another set of skills that haven’t been resident at publishers but that must be employed today.

This morning, Pete has a post at the DBW blog which really tackles the first part of the challenge, spelling out a set of starter tools and techniques are necessary to do a quick-and-dirty assessment of a book’s audience(s). He describes a step-by-step exercise in audience research that can be done in an hour, once the array of tools he describes are mastered.

We used to say 10 and 20 years ago “the Internet changes everything”. I think that is now thoroughly grasped. Today publishers need to accept that “search and the multitude of other means of digital discovery, both observable and dark, change everything about how we create copy”.

4 Comments »

Seven key insights about VMI for books and why it is becoming a current concern


Vendor-managed inventory (VMI) is a supply paradigm for retailers by which the distributor makes the individual stocking decisions rather than having them determined by “orders” from an account. The most significant application of it for books was in the mass-market paperback business in its early days, when most of the books went through the magazine wholesalers to newsstands, drug stores, and other merchants that sold magazines. The way it worked, originally, was that mass-market publishers “allocated” copies to each of several hundred “independent distributors” (also known as I.D. wholesalers), who in turn allocated them to the accounts.

Nobody thought of this as “vendor-managed inventory”. It was actually described as “forced distribution”. And since there was no ongoing restocking component built into the thinking, that was the right way to frame it.

The net result was that copies of a title could appear in tens of thousands of individual locations without a publisher needing to show up at, or even ship to, each and every one.

To make this system functional at the beginning, the books, like magazines, had a predictable monthly cycle through the system. The copies that didn’t sell in their allotted time were destroyed, with covers returned to the publisher for credit.

Over time, the system became inefficient (the details of which are a story for another day, but the long story short is that publishers couldn’t resist the temptation to overload the system with more titles and copies than it could handle) and mass-market publishing evolved into something quite different which today, aside from mostly sticking to standard rack-sized books, works nothing like it did at the beginning.

My father, Leonard Shatzkin, introduced a much more sophisticated version of VMI for bookstores at Doubleday in 1957 called the Doubleday Merchandising Plan. In the Doubleday version, reps left the store with a count of the books on-hand rather than a purchase order. The store had agreed in advance to let Doubleday use that inventory count to calculate sales and determine what should then be shipped in. In 18 months, there were 800 stores on the Plan, Doubleday’s backlist sales had quadrupled and the cost of sales had quartered. VMI was much more efficient and productive — for Doubleday and for the stores — than the “normal” way of stocking was. That “normal” way — the store issues orders and the publisher then ships them — was described as “distribution by negotiation” by my father in his seminal book, “In Cold Type”, and it is still the way most books find their way to most retail shelves.

After my Dad left Doubleday in 1960, successor sales executives — who, frankly, didn’t really understand the power and value of what Dad had left them — allowed the system to atrophy. This started in a time-honored way, with reps appealing that some stores in their territory would rather just write their own backlist orders. Management conferred undue cred on the rep who managed the account and allowed exceptions. The exceptions, over time, became more prevalent than the real VMI and within a decade or so the enormous advantage of having hundreds of stores so efficiently stocked with backlist was gone.

And so, for the most part, VMI was gone from the book business by the mid-1970s. And, since then, there have been substantial improvements in the supply chain. PCs in stores that can manage vast amounts of data; powerful service offerings from the wholesalers (primarily Ingram and Baker & Taylor, but others too); information through services like Above the Treeline; and consolidation of the trade business at both ends so that the lion’s share of a store’s supply comes from a handful of major publishers and distributors (compared to my Dad’s day) and lots of the books go to a relatively smaller number of accounts have all combined to make the challenge of efficient inventory management for books at retail at least appear not to need the advantages of VMI the way it did 60 years ago.

And since so many bookstores not only really like to make the book-by-book stocking decisions, or at least to control them through the systems they have invested in and applying the title-specific knowledge they work hard to develop, there has been little motivation for publishers or wholesalers to invest in developing the capability to execute VMI.

Until recently. Now two factors are changing that.

One is that non-bookstore distribution of books is growing. And non-bookstores don’t have the same investments in book-specific inventory management and knowledge, let alone the emotional investments that make them want to decide what the books are, that bookstores do. Sometimes they just simply can’t do it: they don’t have the bandwidth or expertise to buy books.

And the other is that both of the two largest book chains, Barnes & Noble and Books-a-Million, are seeing virtue in transferring some of the stocking decisions to suppliers. B&N, at least, has been actively encouraging publishers to think about VMI for several years. These discussions have reportedly revolved around a concept similar to one the late Borders chain was trying a decade or more ago, finding “category captains” that know a subject well enough to relieve the chain of the need for broad knowledge of all the books that fall under that rubric.

This is compelling. Finding that you are managing business that could be made more efficient with a system to help you while at the same time some of your biggest accounts are asking for services that could benefit from the same automation are far more persuasive goads to pursue an idea than the more abstract notion that you could create a beneficial paradigm shift.

As a result, many publishing sales departments today are beginning to grapple with defining VMI, thinking about how to apply it, and confronting the questions around how it affects staffing, sales call patterns, and commercial terms. This interest is likely to grow. A well-designed VMI system for books (and buying one off-the-shelf that was not specifically designed for books is not a viable solution) will have applications and create opportunities all over the world. Since delivering books globally is an increasingly prevalent framework for business thinking, the case to invest in this capability gets easier to make in many places with each passing day.

VMI is a big subject and there’s a lot to know and think through about it. I’ve had the unusual — probably unique — opportunity to contemplate it with all its nuances for 50 years, thanks to my Dad’s visionary insight into the topic and a father-son relationship that included a lot of shop talk from my very early years. So here’s my starter list of conceptual points that I hope would be helpful to any publisher or retailer thinking about an approach to VMI.

1. Efficient and commercially viable VMI requires managing with rules, not with cases. Some of the current candidates to develop a VMI system have been drawn into it servicing planograms or spinner racks in non-book retailers. These restocking challenges are simpler than stocking a store because the title range is usually predetermined and confined and the restocking quantity is usually just one-for-one replenishment. We have found that even in those simple cases, the temptation to make individual decisions — swapping out titles or increasing or decreasing quantities in certain stores based on rates of movement — is hard to resist and rapidly adds complications that can rapidly overwhelm manual efforts to manage it.

2. VMI is based on data-informed shipments and returns. It must include returns, markdowns, or disposals to clear inventory. Putting books in quickly and efficiently to replace sold books is, indeed, the crux of VMI. But that alone is “necessary but not sufficient”. Most titles do not sell a single copy in most stores to which they are introduced. (This fact will surprise many people, but it is mathematically unavoidable and confirmed through data I have gotten from friends with retail data to query.) And many books will sell for a while and then stop, leaving copies behind. Any inventory management depending on VMI still requires periodic purging of excess inventory. That is, the publisher or distributor determining replenishment must also, from time to time, identify and deal with excess stock.

3. VMI sensibly combines with consignment and vendor-paid freight. The convention that books are invoiced to the account when they are shipped and that the store pays the shipping cost of returns (and frequently on incoming shipments as well) makes sense when the store holds the order book and decides what titles and quantities are coming in. But if the store isn’t deciding the titles and quantities, it obviously shouldn’t be held accountable for freight costs on returns; that would be license for the publisher or distributor to take unwise risks. The same is really true for the carrying cost of the inventory between receipt and sale. If the store’s deciding, it isn’t crazy for that to be their lookout. But if the publisher or distributor is deciding, then the inventory risk should be transferred to them. The simplest way to do that is for the commercial arrangement to shift so that the publisher offers consignment and freight paid both ways. The store should pay promptly — probably weekly — when the books are sold. (Publishers: before you get antsy about what all this means to your margins, read the post to the end.)

Aside from being fairer, commercially more logical, and an attractive proposition that should entice the store rather than a risky one that will discourage participation, this arrangement sets up a much more sensible framework for other discussions that need to take place. With publisher prices marked on all the books, it makes it clear to the retailer that s/he has a clear margin on every sale for the store to capture (or to offer as discounts to customers). And because the publisher is clearly taking all the inventory risk, it also makes it clear that the account must take responsibility for inventory “shrink” (books that disappear from the shelves without going through the cash register.)

Obviously, shrink is entirely the retailer’s problem in a sale-and-return arrangement; whatever they can’t return they will have paid for. But it is also obvious that retailers in consignment arrangements try to elide that responsibility. Publishers can’t allow a situation where the retailer has no incentive to make sure every book leaving the store goes through the sales scan first.

4. Frequent replenishment is a critical component of successful VMI. No system can avoid the reality that predicting book sales on a per-title-per-outlet basis is impossible to do with a high degree of accuracy. The best antidote to this challenge is to ship frequently, which allows lower quantities without lost sales because new copies replace sold copies with little delay. The vendor-paid freight is a real restraint because freight costs go down as shipments rise, but it should be the only limitation on shipment frequency, assuming the sales information is reported electronically on a daily basis as it should be. The publisher or distributor should always be itching to ship as frequently as an order large enough to provide tolerable picking and freight costs can be assembled. The retailer needs to be encouraged, or helped, to enable restocking quickly and as frequently as cost-efficient shipments will allow.

5. If a store has no costs of inventory — either investment or freight — its only cost is the real estate the goods require. GMROII — gross margin return on inventory investment — is the best measurement of profitability for a retailer. With VMI, vendor-paid freight, and consignment, it is infinity. Therefore, profitable margins can be achieved with considerably less than the 40 to 50 percent discounts that have prevailed historically. How that will play out in negotiations is a case-by-case problem, but publishers should really understand GMROII and its implications for retail profitability so they fully comprehend what enormous financial advantages this new way of framing the commercial relationship give the retailer.

(The shift is not without its challenges for publishers to manage but what at first appears to be the biggest one — the delay in “recognizing” sales for the balance sheet — is actually much smaller than it might first appear. And that’s also a subject for another day.)

6. Actually, the store also saves the cost of buying, which is very expensive for books. The most important advantage VMI gives a publisher is removing the need for a buyer to get their books onto somebody’s shelves. The publisher with VMI overcomes what has been the insuperable barrier blocking them from many retail establishments: the store can’t bear the expense of the expertise and knowledge required to do the buying. It is harder to sell that advantage to existing book retailers who have invested in systems to enable buyers, even if some buyer time can be saved through the publisher’s or distributor’s efforts and expertise. But a non-book retailer looking for complementary merchandise that might also be a traffic builder will appreciate largely cost-free inventory that adds margin and will see profitability at margins considerably lower than the discounts publishers must provide today.

7. Within reasonable limits, the publisher or distributor should be happy to honor input from the retailer about books they want to carry. It is important to remember that most titles shipped to most stores don’t actually sell one single unit. Giving a store a title they’re requesting should have odds good enough to be worth the risk (although that will be proven true or not for each outlet by data over time). Taking the huge number of necessary decisions off a store’s hands is useful for everybody; it shouldn’t suggest their input is not relevant. Indeed, getting information from stores about price or topical promotions they are running, on books or other merchandise, and incorporating that into the rules around stocking books, will help any book supplier provide a better and more profitable service to its accounts. After all, having a store say “I’d like to sell this title for 20 percent off next week in a major promotion, would you mind sending me more copies?” opens up a conversation every publisher is happy to have.

Of course, in a variety of consulting assignments, we are working on this, including system design. It is staggering to contemplate how much more sophistication it is possible to build into the systems today than it was a decade-and-a-half ago when we last immersed ourselves in this. In the short run, a VMI-management system will provide a competitive edge, primarily because it will open up the opportunity to deliver to retail shelves that will simply not be accessible without it. That will lead to it becoming a requirement. As I’ve said here before, a prediction like that is not worth much without being attached to a time scale. I think we’ll see this cycle play out over the next ten years. That is: by 2025, just about all book distribution to retailers will be through a VMI system.

2 Comments »

Starter thoughts for publishers to develop new author marketing policies


In a prior post, we suggested that the time has come for publishers to have clear policies around what they should require from author web presences for an effective publishing partnership. This is a really complex and multi-faceted challenge for every publisher. The purpose of this post is to discuss that proposition in more detail, with a focus on how a publisher should approach developing those policies and the potential contractual relationship changes that they imply.

1. The first step is for a publisher to articulate their minimum standard for an author’s online presence. We have found that the role of web presences an author controls in helping Google and other search engines understand an author’s importance in context is routinely underappreciated. In addition to a properly-SEOd web site, publishers will want to make sure authors fill out their Amazon author page, their Google Plus profile, and their Goodreads page as well. All of this verbal metadata — along with images including photos and book covers — builds a strong foundation for discovery.

Obviously, Facebook, Twitter, LinkedIn, Medium, Instagram, and Pinterest (among others) could also be a constructive part of the web presence for many authors. A publisher’s thinking should include them too, taking cognizance of the fact that they are more important for some authors and topics than for others and that it is hard and cumbersome to do anything about them if the author doesn’t do it for him- or herself.

2. Although many, if not most, authors will have a website or the intention to create one, many others don’t. In that case, the publisher will want to have a fast, inexpensive, and effective way to put one up on the author’s behalf. (The non-website components of the foundation don’t lend themselves as readily to publisher assistance.)

For authors who either don’t have the skills to put up their own WordPress site or the budget to pay for a unique one to be designed and built for them, the publisher should provide a templated interactive process to create a site inexpensively. They also will have to do the research into key words, topics, and phrases to inform the SEO. We believe that for a publisher who will operate at scale, building dozens and perhaps hundreds of these sites per year, the cost should come down to $2,000 or less per site, perhaps $1,000 or less for first-time author sites that have minimal needs for unique book pages.

3. The sites should be seen as author sites which have pages for the individual titles on them, not book sites. That means the publisher has to accept the idea of putting all of an author’s work on the site, which definitely enhances the author’s online authority even though it may promote books from other publishers. Making a site that ignores an author’s whole output is superficially self-serving for a publisher, but it is actually counter-productive if the objective is to promote the author’s online presence and discoverability.

4. Of course, in more cases than not, the author will already have a site. In that case, the publisher won’t be building one but does need to assure itself that the existing site meets the SEO standard. The means an SEO check is necessary, using much of the same knowledge and techniques as the publisher would use to establish the right key words, phrases, and topics they’d use if they were building the site themselves. In addition, publishers should evaluate the site for user experience, including the speed of loading. We’ve seen many author sites which failed on that scale.

5. The publisher should also be giving authors advice about maximizing other opportunities. If the author might blog, suggestions about length, frequency, and topics are worthwhile as are very specific ideas about maximizing the other platforms like Facebook. The publishers should be giving authors a Wish List, making absolutely certain that no opportunity for author-based promotion is ignored because of a lack of awareness on the author’s part. By the same token, knowing what the author is doing enables coordinated marketing, such as the publisher’s own social presences being used to “like” or “favorite” or “recommend” what the author is doing. Doing these things will add to the publisher’s online authority as well as giving boosts to authors on a regular basis.

6. A number of publishing service companies and independent entities have created rosters of freelance service providers that can help authors with their publishing efforts. A lot of these — like cover designers or line editors — are not necessary for an author lucky enough to have a publisher. But we know that authors sometimes want help with ongoing content generation, from blogs to tweets. Although authors should obviously avoid handing over their online identities to surrogates they don’t even know (and that is not what is being suggested here), we know that busy authors can use help with what can be time-consuming social media. Publishers would be much smarter to develop their own list of trusted helpers for this kind of work, perhaps even instructing or training them in order for them to qualify for publisher referrals, than to allow these things to happen by accident or chance. (By the way, this might be a useful way to allow an employee who is on maternity leave or any other sabbatical to stay active from locations other than an office.)

7. Looking across a number of websites enables a publisher to see the impact of Google algorithm changes, which very few authors can do. (This will be particularly important on April 21, when Google starts “punishing” the ranking of sites that aren’t mobile-friendly.) Seeing the behavior of Google for different sites, those “whacked” by a change and those that aren’t (and changes to the algorithms occur all the time, not usually as dramatic or heralded as the one around mobile), allows insight into what needs to be done to benefit from the change, or at least avoid being punished. One person in a publishing house could be helping literally hundreds of authors stay optimized and avoid the need for each of these authors to know enormous amounts about SEO themselves. (Of course, it is also true that an author who is especially brilliant at SEO might not want a publisher focusing on the landing page she created that boosted traffic and teaching other authors to compete with it. Those authors are the exception, not the rule.)

This is not a capability we’ve seen publishers create for themselves, even though they can. We’d argue it is a great benefit for an author to be published by a house that has thought through these requirements and is providing an SEO check and research into search terms. Publishers should be doing this. The early movers will gain a temporary, but substantial, competitive advantage for themselves with authors and for their authors against the field.

8. What should be clear is that the author is being given a choice: they can build their own website (or do the tweaking necessary to one they already have to bring it up to standards) or they can have one built for them by the publisher from the templated choices the publisher offers.

9. This leaves two very large commercial questions for the publisher and author to negotiate, both of which should rise to the level of being covered in the contract. The first one revolves around the investment in and “ownership” of the author’s website and, perhaps the investments needed for ongoing marketing on the author’s behalf. Of course, there is nothing to discuss if the author builds and maintains her own site and social presences. The publisher should still provide all the help they can — SEO research at the beginning and analytics help all along — but there would be no reason for any compensation or publisher ownership.

However, if the publisher invests the dollars to build the author’s site or pays for any of the ongoing efforts by freelancers, there is definitely a negotiation to take place and there are a few moving parts to that negotiation. One way to address this might be for the publisher to advance the money for this work but have the opportunity to recoup it out of proceeds, as though it were part of the advance. Or the publisher could just render the author a bill for the site creation cost (remember, we’re positing $2,000 or less) which the author could simply pay. Another possibility is that the publisher might “own” the author’s website. That is not an end result we would recommend and, if it is necessary, there should be a “buy back” clause that enables the author to recover that ownership if, for example, they move on to another house. In any case, the point to these new elements in the author-publisher agreement is that they assure that what is necessary to optimize 21st century book publication is in place. Both partners in this arrangement — author and publisher — should want that to occur. It really should not be beyond the negotiating capabilities of the two parties to come to a fair agreement about how the necessary investments are compensated.

An approach that could evolve would be that houses have a “web site allotment”, making the sites they create “free”, but then they should pay that same amount in support of authors who create their own sites.

10. The other knotty element that should be negotiated is around the use of email lists that these optimized author sites will generate. It is self-destructive for either the author or the publisher to simply say “they’re mine!” Email list use has a lot of history, but best practices in cases like these are necessarily still evolving. For example, a publisher might build a mammoth email list by working with 10 authors with similar audiences for a promotion going across their email list base. Each author will benefit from being exposed to many readers of the other authors. Most authors will want that to happen if the opportunity is presented to them. Another possibility is that a house does a promotion and each author involved sends a personal note to his/her list letting them know about the promotion which, perhaps, could be a book signing or a webcast. The point is that the house has lists and the authors have lists, each can benefit from collaboration with the other and the house can create synergies by building joint efforts among authors.

These questions are complex but, while time passes, they are not getting any simpler. The value of the web and email list assets that can be optimized with cooperation is increasing, which means the cost of not doing this right is also increasing. It is simply not acceptable for every author and every publisher to avoid the discussion, leaving us with tens of thousands of entities operating in siloed vacuums. That’s the status quo. It isn’t satisfactory.

19 Comments »