Some photos from a Siklu 80GHZ deployment in Downtown Indianapolis, Indiana. This was deployed by On-Ramp Indiana (https://www.ori.net). The problem being solved is moving video files around a network in order to get it to smart screens and projectors. This is a very urban area and wireless was pretty much the only option to get from building to building.
Siklu 80GHZ was on the shortlist due to the distances involved. Another consideration was the footprint of the equipment. The equipment had to be as low profile as possible.
Another needed aspect of this network was the ability to move traffic around at layer 2. Not all traffic is IP based in this type of network.
Ether Haul 1200FX
Some technical Details
As you can see traffic is reasonably consistent in the 80-100 meg range. We needed a solution that did not slow down due to interference. A possible 10’s of thousands of visitors to this attraction in a weekend, reliability and performance were critical. When this was installed we did not know about COVID, but this is an attraction people can enjoy from their cars and social distancing. This use added to the visibility of this attraction, thus making the reliability even more crucial.
Articles about the finished product
After my blog post about Hurricane Electric and RPKi support, I was seeing some comments by folks that warrant some clarification. I put together a short midnight podcast on this. To summarize
1. route original validation is not the same as having ROA’S with your RIR
2. If you have an ASN you should have a peering DB entry
3.ROAs have nothing to do with your router supporting RPKI
A short list of highlights from this release:
– “Zones” feature for support of remote networks, including Unimus Core (remote agent / remote probe)
– Full Config Change Notifications (including a diff) over Slack
– Config Push Scheduling (MCP presets can now be scheduled)
– Push backups into Unimus over our API push endpoint
– Support for binary backups (for now only over the API push endpoint)
– Observium and PRTG support for NMS Sync
– Support for 22 new device types
– MANY other improvements and MANY fixes for various bugs/issues
What is FCC Form 499‑A?
FCC form 499‑A must be filed by interstate or international telecommunications providers in the US to register for the Universal Service Fund and report their revenue. You’ll have the form 499‑A immediately inside your registered agent account with our DC agent information pre-populated on it immediately after signing up for our DC registered agent service.
Inteserra Consulting Group: https://www.inteserra.com/tom-forte
Lerman Senter: https://www.lermansenter.com/attorneys/stephen-e-coran/
Compliance Solutions: https://www.csilongwood.com/
Marashlian & Donahue, PLLC: https://commlawgroup.com/
Over the years my views and philosophies on being a consultant have changed and are constantly evolving. There are certain things that consultants can incorporate into their businesses in order to maintain a high level of service to clients.
One of the things I have tried to do is be neutral when it comes to vendors and technology. While this is an admirable goal to have, you will find yourself gravitating toward technology you and your clients find useful and proven. It’s okay to be a certified consultant for a specific vendor. This brings up a whole new set of issues I will talk about later. There are two keys to take away from this. The first is to understand the underlying technology as a whole. If you think a particular product is superior enough for you to become certified in it, know why. Know how it is better than the competitors and where it lacks compared to the competitors.
The second key is to not be influenced by becoming a reseller/distributor for particular products. If you want to become a distributor, then focus on that. If you offer consulting services, become an integrator for that product. This way, you are not influenced by the latest promotion for a particular product and try to make it fit for a customer when something else might be better.
As a consultant, you will probably find yourself working with specific products more than others. This is natural. I have found myself working with Cambium ePMP products more often than some others. I believe in the product, so I recommend it to my customers when it fits their situation. However, becoming an expert on a product line has pitfalls.
The first pitfall is you are an expert not paid by the vendor. If you are doing an excellent job on Social media and SEO your name should be popping up in google searches for that product. For example, if you do a search for “Cambium Consultant,” the first page that pops up is a page with my info on it. In a way, you are representing the brand without knowing it. This can lead to you answering questions about a product without any direct compensation for your time. I have always strived to answer questions on topics I am an expert on. There is a fine line between answering questions to a client who has not paid you money and one who has. Every potential contact is a potential client. You have to decide how to handle that grey area. This is an area I struggle with regularly. I am a Cambium ePMP expert and get many questions on this and that from folks who are not clients. I try and answer as many as I can, but at the end of the day, the paying clients do take priority.
Distributors and ordering
I mentioned earlier about me personally, not wanting to be a distributor or reseller. I don’t want to have to meet quotas and absolute minimums to keep stock of products. Some companies are better at this than I ever could be. Having a good relationship with a few good distributors is a good idea. Over the years, I have developed good relationships with several of these WISP distributors. There are some I shy away from due to they have competing services. There are a few vendors and distributors I have referred folks to, and the next thing I know they are offering them consulting services or saying, “I can fix that real quick for you”. They may not even realize they are hurting my business. These are distributors and vendors I personally stop referring business to. If it’s the right product, I will still include them in options for clients, but I make sure I keep on top of the relationship between myself, the vendor, and the client.
There are distributors out there who do very well offering consulting services. The question to ask is are they selling you products because the product makes them money or is it the right product for you? There is much room for either way.
Just some random 3am thoughts
Tonight I was reflecting on my career in the Internet Service provider Industry. I have been doing “ISP stuff” since 1992. Back in those days we only had BBSes. For the younger generation, these were Bulletin Board Systems. Think of Facebook without the pictures, the like buttons, the algorithms, and all the stuff we take for granted. These were places you could post messages, download files, and read other messages people have posted. Much like the bulletin board at the local grocery store.
Over the years Internet usage has changed. When I first started with BBSes and my commodore 64’s 300 baud modem, many of the BBSes were long distance. This meant you quickly learned how to navigate the menus and get the information you need. From these BBS days, the Internet Service Provider (ISP) was born. With the invention of HTTP, we now had a standard way of viewing content on this new worldwide web.
I remember visiting a computer lab at Purdue University shortly after I received my driver’s license in 1993.I looked old enough to be attending Purdue so I would wander around campus looking for interesting places to visit. After a few times, I happened across a computer ab in the basement of one of the big buildings on campus. It was a dimly lit place with both PC and Macintosh computers. At that time the Macintosh computers were not as heavily used for anything other than word processing. This meant there were empty computers. I sat down and on the desktop was an icon for Mosaic. I clicked on this and life changed. This was way before the concept of logins and passwords.
For the next several months I would go to Purdue at least one to two times a week and spend several hours reading and printing things off the web, Usenet, and other resources. I managed
to gain a shell account on expert.cc.purdue.edu and was soon learning about mail, ytalk, and Unix shell. I would print off reams of paper and read them at home and school. Anything I could find. The Usenet groups were full of F.A.Q.s about anything from guns to cars to TV shows. One of the ones I remember printing off was a F.A.Q. about Star Trek, It talked about everything from the Warp drives, to how phasers worked, etc. Of course, this was all about a TV show but was fascinating. I had an entire topic on a subject at the touch of a button. The folks maintaining these newsgroups were the first real content creators.
Founded by two telecommunications veterans in 2018, Atheral is building customer-centric white- label and wholesale cloud solutions for Internet Service Providers that decrease end-user churn and increase profitability while being geo-redundant, highly available, and scalable. We focus on redefining technology in the cloud to minimize capital expenses while providing a predictable operating cost.
Atheral’s core white-label Voice over Internet Protocol (VoIP) platform is simple, flexible, and feature- rich with unique US-based support resources. Atheral is the only white-label VoIP wholesaler that focuses on WISPs while providing a customized branded experience for their end-users. Pricing, just like our platform, is feature-rich and straightforward:
- Unlimited local and long-distance calling in the United States, Mexico, and Canada
- One telephone number per user and e911 registration
- Branded customer-facing documentation
- 140+ Softswitch features
- Our companion Android and IOS softphone app
Why should a WISP care about VoIP?
- Government Funded Competition – Offering VoIP with your awesome broadband experience protects your ISP from being overbuilt by government-funded competitors or enables you to apply for government funding to expand your coverage area.
- Customer Stickiness – Customers that purchase value-added services are more likely to stay customers, especially when they are satisfied with those services.
- High Margin – While phone service in the home may be declining, VoIP is growing by leaps and bounds in the business community with the VoIP industry seeing ~21% annual growth through 2025. All those added users equal high margin for you – the average VoIP reseller sees margins in the 40%-65% range.
As some of you may have heard Mikrotik has added in some VXLAN support in the latest RouterOS7 beta. What is VXLAN and how would service providers use it? Let’s start out with some broad information about VXLAN
The always interesting RFC read
This document describes Virtual eXtensible Local Area Network (VXLAN), which is used to address the need for overlay networks within virtualized data centers accommodating multiple tenants. The scheme and the related protocols can be used in networks for cloud service providers and enterprise data centers
Boil it down for me. What is vxlan?
In short, VXLAN allows you to create a layer2 network on top of a layer3 network. It allows you to bind separate layer2 domains and make them look like one. If you are thinking this looks like a GRE tunnel, you are correct except the layer2 domains are still separate with tunnels. VXLAN is mainly touted as a way to interconnect data centers. If you are having to use spanning-tree then VLXLAN is an answer.
Okay, but why not use tunnels or MPLS?
VXLAN allows you to accomplish what GRE does without having to change the network design. By using VXLAN you are also able to have standalone layer2 domains that talk to each other. With the tunnel approach, you have to do a lot of manual configuration.
Is this just a data center thing?
VXLAN was designed to solve many of the edge computing and hyper-scale computing issues. Imagine having compute nodes in different parts of a data center or even in different data centers. You want all of those nodes on the same VLAN. With GRE you could extend that VLAN, but with VXLAN you can have two standalone layer2 VLANs that are merged together. VXLAN also solves the 4096 VLAN issue. This is important in hyper-scale cloud computing.
VXLAN benefits in a nutshell
- increases layer2 segments to 16 million
- Centralize control
VXLAN downsides in a nutshell
- Multicast must be available
- more overhead to layer2 packet
- no built-in encryption
- Slow adoption of ipv6 support by open source
What about the service provider? How can I use this?
In a service-provider network, you have things like broadcast issues. Basically, bridging is bad. Your layer2 networks need to be contained. Imagine you are a service provider who is providing LTE services. You may have an LTE VLAN on your network. Historically you would have to extend your VLAN across the network in order to do management and access your LTE core. Now you have this large broadcast domain across your entire network. Or worse yet, you have tunnels to other cities or locations you don’t have physically connected to your network. Now you have tunnels a part of your LTE VLAN. MTU issues and other things are now a part of your life.
With VXLAN each LTE node can have its own layer2 VLAN but still talk to the others. This prevents the broadcast storms which can occur.
Another use for VXLAN is a way to allow managed service providers to deploy large scale networks over the 4000 limits of VLANs. You could literally deploy thousands of layer2 segments to tenants
Why I should or should not care about VXLAN as a service provider?
If you just have a couple of layer2 networks to extend across your network VXLAN is not for you. However, VXLAN does allow for multipath routing and other protocols to be extended to remote networks.
VXLAN adds 50+ bytes of overhead to the layer2 frame. In many service provider networks, this is not an issue due to MTU being raised for MPLS, etc. IP multicast must be extended across the entire network. Mac addresses are used in creating a distribution network across all of the routed layer2 domains.
Large service providers have started looking at segment routing to solve many of the issues I talk about. This causing them to gravitate toward EVPN. EVPN allows for BGP for the control plane and MPLS for the data plane. More on this coming soon.
In closing, VXLAN is an ultra-cool technology and has use cases for service providers. Other methods also exist to solve these issues in the service provider world. For those of you looking to learn all you can, I will be posting a list of links for my Patreon folks.
I have a few nitpicky things and the video seems a little contrived, but it’s decent nonetheless. WISPs are not really mentioned, but others are not as well.