Share
9 min read
Share
Running applications at the edge offers many advantages if architected well, including lower latency and cost effectiveness, as well as easier compliance with privacy and data regulations, especially for data-heavy workloads. By bringing the application closer to where your data is, these advantages translate into faster response times and more timely, valuable insights. However, developing, deploying and maintaining applications at the edge remains incredibly painful today.
The edge exposes the need for a completely new development framework, replete with newer data management APIs and services, novel ways of invoking, slicing and stitching together artificial intelligence/ machine learning toolchains, and a new set of energy-efficient AI/ML algorithms for computer vision and natural language understanding (NLU). Operationally, to work over highly distributed environments, optimized workload scheduling across incredible heterogeneity in computing architectures, and the simplification of application development, deployment and lifecycle management needs to be enabled.
In short, the edge is not your grandfather’s cloud. It is a whole new paradigm for application development and operational simplicity.
There are myriad challenges software development and site reliability engineering (SRE) teams need to address.
First, there is a need to balance myriad conflicting requirements:
Second, there are significant challenges in the operating model, which is a far cry from the centralized operating model of the cloud. Securely installing, configuring and handling life cycle management, including API, service and tooling upgrades; event-driven scaling to save on operational costs and load-balancing across all edge locations and the cloud; continuing to operate and recover from potential WAN outages; complying with local data regulation needs – all based on the assumption that possibly non-technical personnel will be handling large percentages of the edge’s day-to-day operational needs.
Because they are up against so much, many enterprises end up delaying their digitization plans and lose out on valuable insights and new revenue streams.
One could approach solutions to these challenges from two diametrically opposite directions. Currently, many of the major cloud service providers (CSPs) are trying to tailor and extend their cloud platform – for example, Google Anthos or Amazon Outpost – to solve the edge development and operational challenges. The rationale being quite simple: to bring to the edge the same development and operational paradigm a customer is used to in their public cloud and the promise of seamlessness, especially if you have bet on a singular cloud provider. This is called Cloud-Out.
Since large-scale cost-effective public cloud hardware is built and operated using very different optimizations in mind, they pose a host of challenges when being retrofitted to an edge environment.
For starters, no one plans out the power-cooling-space requirements of an edge in the same manner that a cloud data center is planned for, which is quite a formal and methodical process. Often those envelopes are handed down to an edge compute location and are typically highly resource constrained – think retail, health care, enterprise branch, cameras, robotic entities, etc. This is called Edge-In.
Second, there could be very limited support for a CSP’s hardware matrix. Edge-In compute locations come in various permutations of compute, memory, network, storage, uplink, AI/ML co-processing and security offload engines.
CSP software stacks are also typically designed for larger workloads, and availability, reliability and performance are handled architecturally via hierarchical designs that don’t translate easily to Edge-In deployments.
Operationally, CSPs approaches to edge deployments assume uplink and WAN connectivity to drive their maximum benefit as centralized SRE teams drive efficiency in a cloud environment, which is not a great assumption to make for Edge-In deployments.
Industry experts anticipate that only about 20 percent of applications at the edge will use these Cloud-Out solutions, while a large majority will rely on Edge-In approaches. But the cloud is clearly here to stay, so any Edge-In approach will have to work seamlessly with, though not identically to, a cloud operating model.
To enable a new slew of edge applications, developers need help with two categories of edge services: one around new APIs for application development, and another for simplified life cycle management.
Creating a new class of highly distributed data-heavy application development will require software services and APIs for:
To simplify life cycle management for large-scale, lightweight distributed deployments, we need to enable consistent edge-to-cloud application deployments on the edge side with the following elements:
The best way to showcase the true value of application development at the edge is through an example of what the future could look like when this process is optimized.
Imagine an automated retail environment where cameras sense and enable the autonomous shopping journey for a customer as they enter, shop through a few aisles picking up items, and then check out at a cashier-less register. A computer vision application would ensure queue management at the set of registers in the store and over time, learn about the queue depths the store needs to handle.
The autonomous data-heavy edge applications would also allow for inventory management – both on the aisles, as well as in the back storage areas. They could provide insights into which brands are being successful at which stores across the retailer’s global footprint. Additional edge apps would use this data to deliver hyperlocal product advertising on event-driven displays in the store. All of this would run on low-cost, lightweight edge nodes with appropriate security permissions, adapt to ever-changing retail-level network connectivity based on end-to-end observability and allow for simple app life cycle management that could be performed easily by a thin staffing of store personnel.
Imagine the possibilities if we were able to create this future.
Get emerging insights on innovative technology straight to your inbox.
Discover how AI assistants can revolutionize your business, from automating routine tasks and improving employee productivity to delivering personalized customer experiences and bridging the AI skills gap.
The Shift is Outshift’s exclusive newsletter.
The latest news and updates on generative AI, quantum computing, and other groundbreaking innovations shaping the future of technology.
