Digital Society: Preserving the open and competitive bandwidth market

interns Contributor
Font Size:

Something unfortunate happened in the search for Net Neutrality and an “open Internet”. We have essentially been asked to suspend economic reason and accept the premise that the commodity of Internet server bandwidth is not a free market but a low-cost fixed rate service. We are told by proponents of Net Neutrality that the Internet is a place where the smallest websites that might pay tens of dollars per month for Internet connectivity have the same capability as the largest websites that pay millions per month for Internet connectivity. “Equal access for equal payment” has been replaced with “equal access for any payment”. By trying to “preserve” a vision of the Internet that never even existed, Net Neutrality would eliminate the existing open and competitive Internet server bandwidth market.

The server bandwidth market has existed since the beginning of the commercial Internet. Businesses seeking to have a significant presence on the Internet meet at Internet Exchange Points (IXPs) which are large data centers that offer connectivity between Content, Application, Service (CAS) providers and network providers of all sizes and shape. These IXPs act as a type of open market for server bandwidth where content providers have a multitude of providers to pick from to get the best rates. Network operators can peer (trade) or buy bandwidth from one another, and CAS providers can buy bandwidth from network operators or even negotiate peering agreements for free or for a fee that they deem cost effective.

But because we are told by Net Neutrality proponents that some network operators (notably those who provide broadband services) must not be permitted to sell and become “gateways” to the Internet, and because we are told that connectivity must have the same capability regardless of cost, we are in danger of losing the open and competitive bandwidth market in the server space. The current draft of the FCC’s proposed “Net Neutrality” NPRM regulations to include rules that would forbid broadband providers from charging Content, Application, or Service (CAS) providers for “enhanced or prioritized” distribution to broadband consumers. These rules in paragraph 106 of the draft FCC NPRM are notably vague and open ended, and there is strong possibility that it will eliminate a number of affordable and effective ways of purchasing bandwidth that CAS providers can currently choose from. That means Net Neutrality could have the opposite effective of increasing the cost of Internet connectivity for businesses and reduce innovation on the Internet.

The traditional (and still common) way of gaining a presence on the Internet for businesses is to buy dedicated “transit” bandwidth from an Internet Service Provider (ISP) at a data centers. This is the method that most businesses are familiar with. Transit service is a convenient “one stop shop” that allows a business to reach any part of the Internet, but it is one of the more expensive forms of bandwidth because the data being transmitted has to incur the cost of the transit ISP and the Internet backbone which is expensive since it is effectively a leased global network. Typical 2009 costs for transit bandwidth ranges from $2 to $9 per Megabit per second (Mbps) per month depending on the commitment level (quantity discounts). So a small 100 Mbps transit circuit at a data center might cost $900 per month, and a big 10,000 Mbps transit circuit might cost $40,000 per month in the United States.

The performance and reliability of transit connections are limited because of the complex arrangement of the network. Any congestion within the transit provider or Internet backbone or the broadband provider, and especially the interconnections between these three infrastructure entities will reduce the performance of data going from the CAS provider to the End User. Any connectivity problems within or between any of these infrastructure entities will cause the End User to lose access to the CAS provider and there nothing the CAS or End User can do but wait for the problem to get repaired. At certain times when some key interconnection circuit goes down or if there is a peering dispute within the cloud, some connections can be lost for hours to several days.

Note: Hosting servers outside of data centers is more expensive because it incurs last-mile lease lines charges in addition to the transit charges. Residential broadband service is cheap but it is inappropriate for hosting content because the bandwidth is shared at a typical ratio of 20:1 to 40:1, and the Terms of Service (ToS) for broadband don’t accommodate servers.

In the last decade of the Internet, the emergence of Content Deliver Networks (CDNs) like Akamai and Limelight has changed the way that popular high bandwidth content (mostly video) gets delivered to the End Users. CDN is an even more convenient one stop shop than transit service because not only does it provide a global distribution network for a business’ bandwidth needs, it also offloads their server and IT infrastructure requirements. So for this reason, CDN services (at similar commitment levels) are almost always going to be more expensive than just transit bandwidth costs alone, but CDN providers argue that it may still be cheaper overall because a business doesn’t need to build out their own server and data center infrastructure or hire engineers to design, build, and operate the network. For businesses that don’t necessarily have the ability or will to handle everything on their own, CDN services make sense. For other larger content providers who have the scale to justify their own IT infrastructure, they may choose to go other routes.

But more recently, broadband providers are trying to get into the CDN market as well. They may or may not provide a one stop shop with global reach, but they might be able to offer competitive rates and potentially some other performance benefits as well. Businesses looking for CDN services can ignore these ISP CDN providers, completely switch over to one of them, or partially switch over to them while simultaneously using one of the more traditional CDN providers. The nice thing about having the broadband providers compete in the CDN market is that it puts pricing pressure on the few dominant CDN providers like Limelight and Akamai. But the currently proposed FCC NPRM Net Neutrality regulations prohibit broadband providers from offering CAS providers “enhanced” services, and that would eliminate competition in the CDN market which ultimately produces the opposite effect intended by the NPRM.

Another more recent innovative way of buying server bandwidth on the Internet is the Paid Peering model. Instead of paying $3 to $9 per Mbps per month for transit connectivity, CAS providers can directly peer with the broadband network they’re trying to deliver content to and only pay $1 to $3 per Mbps per month. These Paid Peering services only offer specific connectivity to the broadband provider’s network and not global connectivity, but it offloads the traffic that would have had to go over the more expensive transit service and therefore saves the CAS provider money. So a CAS provider would simultaneously use their transit service to reach destinations that they don’t directly peer with and they would use the Paid Peering services to reach specific destinations.

Furthermore, all the performance and reliability problems of transit services vanish because of the shorter and more direct method of connection. We have real-world testimony of this from CAS providers who have experienced 2-3 times better performance with Comcast’s Paid Peering product and others who were able to overcome routing problems by switching to Paid Peering. The technical support provided by Paid Peering services are also said to be superior.

Despite the obvious benefits of Paid Peering, the proposed FCC NPRM Net Neutrality rules would prohibit broadband providers from offering these “enhanced” services to CAS providers. That would have brutal consequences for nearly all CAS providers that are not “hyper giants” because it would force them to buy slower and more expensive transit services. It would effectively prohibit CAS providers from buying cheaper and better wholesale bandwidth.

Internet “hyper giants” like Google don’t care for Paid Peering because they have such a large private Internet infrastructure and they account for 7% of all Internet traffic. That leverage allows them to negotiate free peering agreements with many ISPs and the elimination of Paid Peering products would only give them even more leverage to negotiate free peering agreements with the few ISPs that are holding out for Paid Peering agreements, and it would simultaneously restrain their smaller competitors in the CAS provider market who can’t possibly negotiate free peering deals which would ensure Google’s dominance.

Note: Google can get free peering because they have such a massive infrastructure of their own that they have built and paid for and because they have so much clout to negotiate. If anyone could get free peering, no one would ever pay for Internet bandwidth again which would mean an economic collapse in the Internet economy since only the Internet Peering Exchanges can extract revenue. But IXPs don’t pay the bulk of the Internet’s infrastructure costs such as the long haul cross country and intercontinental circuits or the millions of last-mile connections, the IXPs only pay to interconnect and house the various players in the relatively inexpensive data centers. CAS providers don’t build out the expensive infrastructure which is why they have to pay to peer. Furthermore, ISPs and broadband providers also get no ad revenue from content traffic and ISPs don’t get usage revenue from End Users because Broadband services are flat rate. CAS providers on the other hand get revenue for every bit that their servers deliver to the End Users. The only way that ISPs and Broadband providers can get any revenue for building out infrastructure is to charge for transit, peering, or broadband connectivity and broadband subscribers can’t bear the cost alone. A world with free on-ramps for CAS providers is simply not economically viable.

Another innovative model that ISPs could offer is a caching service similar to option 2 above that also provides bandwidth guarantees to End Users. So if a content provider wants to deliver content to End Users at 8 Mbps but some End Users only paid for 3 Mbps broadband connectivity, the ISP could temporarily boost the performance of those lower tier End Users to 8 Mbps. The CAS provider would pay for the bandwidth boost of the End User (similar to how an online retailer could offer free shipping to consumers when they buy a product), and the consumer would benefit from the lower shipping rates that the CAS provider can negotiate. The same last-mile bandwidth boost capability could also be offered to CDN retailers like Akamai and Limelight so that they can also offer the same capability to their customers.

The concept of CAS provider paying for End User access is nothing new and it is the model used by the Amazon Kindle e-book reader and a number of alternatives that are coming onto the market this year. Unfortunately, this type of enhanced service may run afoul of the proposed FCC Net Neutrality rules and that would eliminate the open bandwidth market and stifle innovation on the Internet.

Another innovative approach is an enhanced Paid Peering model that also boosts last-mile bandwidth. Similar to Option 3 above, this model could also provide a last mile bandwidth boost paid for by the CAS provider. Again, the same last-mile bandwidth boost capability could also be offered to CDN retailers like Akamai and Limelight so that they can also offer the same capability to their customers. Again, the FCC NPRM would threaten this enhanced service.

Another variation on Option 3 is a Paid Peering service with a prioritized QoS profile. This type of service wouldn’t use a caching infrastructure since it involves real-time low latency applications like gaming, and it’s a typically a low bandwidth service since online gaming uses less than 100 Kbps each direction whereas video content is 300 Kbps to 8000 Kbps. Blizzard Entertainment for example has a partnership with Nordic based ISP and broadband provider TeliaSonera that includes a prioritized QoS profile which provides low-latency Internet connectivity.

Since many feel that ISPs shouldn’t decide what traffic gets prioritized and what doesn’t and that only the end-points (the user and content provider) should decide, the prioritization (especially over the last-mile network where it is most noticeable and effective) should be something that the end points asked for. But this can be handled through clear disclosure and the user would be informed that when they purchase the service, they’re also purchasing and approving the prioritized data access which would give them superior service. The first time the End User uses the service, they’re informed of the packet prioritization taking place and they have to opt into the service. That means both the end points not only approve of the prioritization taking place in the network, but they’re actually paying for it.

With near certainty, the proposed FCC Net Neutrality rules would threaten this type of “enhanced and prioritized” service even though it is being asked for by the End User and the CAS provider. But who exactly is the NPRM supposed to be protecting if not the wishes of the End User and CAS provider?

Lastly, another innovative technology is multicasting which allows information to be sent once to millions of users one time rather than millions of times. We can imagine another variation of Paid Peering that facilitates multicasting. This solution is extremely scalable and efficient for wired and even wireless broadband networks and it is less expensive for the CAS provider because it incurs less bandwidth consumption in all parts of the network. Yet the currently proposed FCC NPRM Net Neutrality rules seem to prohibit this type of “enhanced” and innovative network architecture.

Conclusion:

Innovation on the Internet is too precious to stifle and the FCC must carefully examine all the ramifications of their proposed regulations. It must move beyond flawed Net Neutrality economic studies and have a thorough look at the facts. This paper hopefully provides a useful starting point for debating the merits of “enhanced and prioritized” services.

George Ou was a Senior Analyst at ITIF.org before joining Digital Society. Before that, he was Technical Director and Editor at Large at ZDNet.com and wrote one of their most popular blogs “Real World IT“. Before journalism, Mr. Ou was a network engineer. He built and designed wired network, wireless network, Internet, storage, security, and server infrastructure for various fortune 100 companies. George Ou is also a Certified Informations Systems Security Professional.

PREMIUM ARTICLE: Subscribe To Keep Reading

Sign up

By subscribing you agree to our Terms of Use

You're signed up!

Sign up

By subscribing you agree to our Terms of Use

You're signed up!
Sign up

By subscribing you agree to our Terms of Use

You're signed up!

Sign up

By subscribing you agree to our Terms of Use

You're signed up!
Sign up

By subscribing you agree to our Terms of Use

You're signed up!

Sign Up

By subscribing you agree to our Terms of Use

You're signed up!
Sign up

By subscribing you agree to our Terms of Use

You're signed up!
Sign up

By subscribing you agree to our Terms of Use

You're signed up!
BENEFITS READERS PASS PATRIOTS FOUNDERS
Daily and Breaking Newsletters
Daily Caller Shows
Ad Free Experience
Exclusive Articles
Custom Newsletters
Editor Daily Rundown
Behind The Scenes Coverage
Award Winning Documentaries
Patriot War Room
Patriot Live Chat
Exclusive Events
Gold Membership Card
Tucker Mug

What does Founders Club include?

Tucker Mug and Membership Card
Founders

Readers,

Instead of sucking up to the political and corporate powers that dominate America, The Daily Caller is fighting for you — our readers. We humbly ask you to consider joining us in this fight.

Now that millions of readers are rejecting the increasingly biased and even corrupt corporate media and joining us daily, there are powerful forces lined up to stop us: the old guard of the news media hopes to marginalize us; the big corporate ad agencies want to deprive us of revenue and put us out of business; senators threaten to have our reporters arrested for asking simple questions; the big tech platforms want to limit our ability to communicate with you; and the political party establishments feel threatened by our independence.

We don't complain -- we can't stand complainers -- but we do call it how we see it. We have a fight on our hands, and it's intense. We need your help to smash through the big tech, big media and big government blockade.

We're the insurgent outsiders for a reason: our deep-dive investigations hold the powerful to account. Our original videos undermine their narratives on a daily basis. Even our insistence on having fun infuriates them -- because we won’t bend the knee to political correctness.

One reason we stand apart is because we are not afraid to say we love America. We love her with every fiber of our being, and we think she's worth saving from today’s craziness.

Help us save her.

A second reason we stand out is the sheer number of honest responsible reporters we have helped train. We have trained so many solid reporters that they now hold prominent positions at publications across the political spectrum. Hear a rare reasonable voice at a place like CNN? There’s a good chance they were trained at Daily Caller. Same goes for the numerous Daily Caller alumni dominating the news coverage at outlets such as Fox News, Newsmax, Daily Wire and many others.

Simply put, America needs solid reporters fighting to tell the truth or we will never have honest elections or a fair system. We are working tirelessly to make that happen and we are making a difference.

Since 2010, The Daily Caller has grown immensely. We're in the halls of Congress. We're in the Oval Office. And we're in up to 20 million homes every single month. That's 20 million Americans like you who are impossible to ignore.

We can overcome the forces lined up against all of us. This is an important mission but we can’t do it unless you — the everyday Americans forgotten by the establishment — have our back.

Please consider becoming a Daily Caller Patriot today, and help us keep doing work that holds politicians, corporations and other leaders accountable. Help us thumb our noses at political correctness. Help us train a new generation of news reporters who will actually tell the truth. And help us remind Americans everywhere that there are millions of us who remain clear-eyed about our country's greatness.

In return for membership, Daily Caller Patriots will be able to read The Daily Caller without any of the ads that we have long used to support our mission. We know the ads drive you crazy. They drive us crazy too. But we need revenue to keep the fight going. If you join us, we will cut out the ads for you and put every Lincoln-headed cent we earn into amplifying our voice, training even more solid reporters, and giving you the ad-free experience and lightning fast website you deserve.

Patriots will also be eligible for Patriots Only content, newsletters, chats and live events with our reporters and editors. It's simple: welcome us into your lives, and we'll welcome you into ours.

We can save America together.

Become a Daily Caller Patriot today.

Signature

Neil Patel