Astronaut loading animation Circular loading bar

Try : Insurtech, Application Development

AgriTech(1)

Augmented Reality(20)

Clean Tech(7)

Customer Journey(16)

Design(39)

Solar Industry(7)

User Experience(62)

Edtech(10)

Events(34)

HR Tech(3)

Interviews(10)

Life@mantra(11)

Logistics(5)

Strategy(17)

Testing(9)

Android(48)

Backend(32)

Dev Ops(8)

Enterprise Solution(28)

Technology Modernization(4)

Frontend(29)

iOS(43)

Javascript(15)

AI in Insurance(36)

Insurtech(63)

Product Innovation(54)

Solutions(21)

E-health(11)

HealthTech(23)

mHealth(5)

Telehealth Care(4)

Telemedicine(5)

Artificial Intelligence(139)

Bitcoin(8)

Blockchain(19)

Cognitive Computing(7)

Computer Vision(8)

Data Science(17)

FinTech(51)

Banking(7)

Intelligent Automation(27)

Machine Learning(47)

Natural Language Processing(14)

expand Menu Filters

Vagrant: Building and maintaining portable virtual software development environment

I had a new developer joining my team. But onboarding required him to successfully install all the necessary software. The project was complex with a disparate set of software, and modules required to make all of it work seamlessly. Despite best efforts, it took the developer a couple of hours to completely set up his machine.

vagrant

It set me to think if there is something that can be done to improve and expedite this onboarding. Why should it take a new developer so much time to set up his system when the very same activity has been done a couple of times before by earlier developers.

A little bit of ‘googling’ made me stumble upon some thing called Vagrant. Perhaps I was too ignorant before, but now I realize there exists better ways to handle this problem. The activity that took our developer hours can be finished in a few minutes.

Here is how Vagrant can help you set up your development environment in minutes.

  1. Install the latest version of Vagrant from https://www.vagrantup.com/downloads.html. You can download the version for your OS. You can also read more about Vagrant from https://www.vagrantup.com/docs/getting-started/
  1. After installing Vagrant, you will need to install VirtualBox from https://www.virtualbox.org

Now that you have installed Vagrant, and the Virtual Box, lets play around a bit with it.

From your bash shell you can run the following commands

$ init hashicorp/precise64

$ vagrant up

After running the above commands, you will have a fully running Virtual Machine running Ubuntu 12.04 LTS 64 bit. You can SSH into the machine with

vagrant ssh

, and when you are done playing around with your newly created virtual machine, you may choose to destroy it by running; vagrant destroy

Next Steps

Now that you have created a virtual environment, lets see how we can get started with creating a new vagrant aware project.

New Project

Setting up a new project would require us creating a new directory, and then running the init command inside the directory.

$ mkdir new_vagrant_project

$ cd new_vagrant_project

$ vagrant init

The last init command above will place a new file Vagrantfile inside the current directory. You may also choose to convert an existing project to make it vagrant aware by running the same vagrant init command from an existing directory.

So far all you have in your directory is one single file called Vagrantfile. But where is the OS? We have not yet installed it. How will my project run in my favorite OS?

Answers to above questions lie in the VirtualBox. Virtual Box is the software, which is the container for your OS. Instead of building the virtual machine from scratch, which would be slow and tedious process as all the OS files will need to be downloaded every time, Vagrant uses a base image to quickly clone the virtual machine. These base images are called boxes in vagrant, and as Vagrant website also says “specifying the box to use for your vagrant environment is the first step after creating a new Vagrantfile”.

The virtual box type or the OS need to be specified in Vagrantfile. Below is how you can tell Vagrant that you would like to use Ubuntu Precise 64 to run your application on.

Vagrant.configure(“2”) do |config|

config.vm.box = “hashicorp/precise64”

end

Vagrant gives you a virtual environment of a server with any OS of your liking. In this example, we added Precise 64 version of the Ubuntu OS. However if you would like to add anything else, you can search for options here

https://app.terraform.io/session

Its time to bootup the virtual machine. It can be done using

vagrant up

Next we can log in to the machine by running

vagrant ssh

When you are done fiddling around with the machine, you can destroy it by running vagrant destroy.

Now that the OS is ready, its time to install necessary softwares, and other dependencies. How do we do that?
Enter Ansible!!

Ansible helps us in provisioning the virtual machine booted up in the steps above. Provisioning is nothing but configuring, and installing different dependencies required to run on your application.

Ansible (http://docs.ansible.com/ansible/index.html) can be downloaded, and installed on your machine from http://docs.ansible.com/ansible/intro_installation.html#installing-the-control-machine

Please note that Ansible is not the only provisioning tool that can work with Vagrant. Vagrant works equally well with other provisioners like Puppet, Chef, etc.

The provisioner, Ansible in the current case needs to be configured with the Vagrant so that virtual machine knows how it should provision the machine after boot up.

The basic Vagrantfile Ansible configuration looks like

Vagrant.configure(“2”) do |config|

config.vm.box = “hashicorp/precise64”

config.vm.network ‘private_network’, ip: ‘192.168.1.x’

config.vm.network ‘forward_port’, guest: xxxx, host: yyyy

config.vm.provision “ansible” do |ansible|

ansible.playbook = “playbook.yml”

end
end

The configuration ‘private_network’ will give an IP to your virtual machine so that traffic can flow from/to the virtual machine.

The ‘forward_port’ configuration enables us to specify that requests coming on a port xxxx to the virtual machine from outside will be routed inside the VM on an application listening on port yyyy.

Playbook is a very integral component of Ansible. Playbook contains instructions that Ansible will execute to ready your machine. These instructions can be a list of softwares to be downloaded, and installed, or any other configuration that your application requires to function properly. Playbooks are expressed in YAML format. Each playbook is composed of one or more ‘plays’ in a list.

The goal of a play is to map a group of hosts to some well-defined roles, represented by ‘tasks’.

Here is a playbook example with just one play.

- hosts: webservers

vars:

http_port: 80

max_clients: 200

remote_user: root

tasks:

- name: ensure apache is at the latest version

yum: name=httpd state=latest

- name: write the apache config file

template: src=/srv/httpd.j2 dest=/etc/httpd.conf

notify:

- restart apache

- name: ensure apache is running (and enable it at boot)

service: name=httpd state=started enabled=yes

handlers:

- name: restart apache

service: name=httpd state=restarted

A playbook can also have multiple plays, with each play executing on a group of servers. You can also have multiple plays in a playbook, with each play running on a different group of servers as in http://docs.ansible.com/ansible/playbooks_intro.html

In the next part of this series, I will take a real example where an application requires multiple software, and configurations, and how we make use of Vagrant & Ansible to run it in the developer’s machine, and then automate deployment to the cloud servers.

In case, you any queries on Virtualizing Your Development Environment To Make It A Replica Of Production, feel free to approach us on hello@mantralabsglobal.com, our developers are here to clear confusions and it might be a good choice based on your business and technical needs.

This guest post has been written by Parag Sharma Mantra Labs CEO.

He is an 14 year IT industry veteran with stints in companies like Zapak and RedBus before founding Mantra Labs back in 2009. Since then, Mantra has dabbled in various products and is now a niche technology solutions house for enterprises and startups.

Mantra Labs is an IT service company and the core service provided by the company are Web Development, Mobile Development, Enterprise on the Cloud, Internet of Things. The other services provided by the company are Incubate start-up, provide Pro-active solutions and are Technical Partners of Funds & Entrepreneurs.

Cancel

Knowledge thats worth delivered in your inbox

Platform Engineering: Accelerating Development and Deployment

The software development landscape is evolving rapidly, demanding unprecedented levels of speed, quality, and efficiency. To keep pace, organizations are turning to platform engineering. This innovative approach empowers development teams by providing a self-service platform that automates and streamlines infrastructure provisioning, deployment pipelines, and security. By bridging the gap between development and operations, platform engineering fosters standardization, and collaboration, accelerates time-to-market, and ensures the delivery of secure and high-quality software products. Let’s dive into how platform engineering can revolutionize your software delivery lifecycle.

The Rise of Platform Engineering

The rise of DevOps marked a significant shift in software development, bringing together development and operations teams for faster and more reliable deployments. As the complexity of applications and infrastructure grew, DevOps teams often found themselves overwhelmed with managing both code and infrastructure.

Platform engineering offers a solution by creating a dedicated team focused on building and maintaining a self-service platform for application development. By standardizing tools and processes, it reduces cognitive overload, improves efficiency, and accelerates time-to-market.  

Platform engineers are the architects of the developer experience. They curate a set of tools and best practices, such as Kubernetes, Jenkins, Terraform, and cloud platforms, to create a self-service environment. This empowers developers to innovate while ensuring adherence to security and compliance standards.

Role of DevOps and Cloud Engineers

Platform engineering reshapes the traditional development landscape. While platform teams focus on building and managing self-service infrastructure, application teams handle the development of software. To bridge this gap and optimize workflows, DevOps engineers become essential on both sides.

Platform and cloud engineering are distinct but complementary disciplines. Cloud engineers are the architects of cloud infrastructure, managing services, migrations, and cost optimization. On the other hand, platform engineers build upon this foundation, crafting internal developer platforms that abstract away cloud complexity.

Key Features of Platform Engineering:

Let’s dissect the core features that make platform engineering a game-changer for software development:

Abstraction and User-Friendly Platforms: 

An internal developer platform (IDP) is a one-stop shop for developers. This platform provides a user-friendly interface that abstracts away the complexities of the underlying infrastructure. Developers can focus on their core strength – building great applications – instead of wrestling with arcane tools. 

But it gets better. Platform engineering empowers teams through self-service capabilities.This not only reduces dependency on other teams but also accelerates workflows and boosts overall developer productivity.

Collaboration and Standardization

Close collaboration with application teams helps identify bottlenecks and smooth integration and fosters a trust-based environment where communication flows freely.

Standardization takes center stage here. Equipping teams with a consistent set of tools for automation, deployment, and secret management ensures consistency and security. 

Identifying the Current State

Before building a platform, it’s crucial to understand the existing technology landscape used by product teams. This involves performing a thorough audit of the tools currently in use, analyzing how teams leverage them, and identifying gaps where new solutions are needed. This ensures the platform we build addresses real-world needs effectively.

Security

Platform engineering prioritizes security by implementing mechanisms for managing secrets such as encrypted storage solutions. The platform adheres to industry best practices, including regular security audits, continuous vulnerability monitoring, and enforcing strict access controls. This relentless vigilance ensures all tools and processes are secure and compliant.

The Platform Engineer’s Toolkit For Building Better Software Delivery Pipelines

Platform engineering is all about streamlining and automating critical processes to empower your development teams. But how exactly does it achieve this? Let’s explore the essential tools that platform engineers rely on:

Building Automation Powerhouses:

Infrastructure as Code (IaC):

CI/CD Pipelines:

Tools like Jenkins and GitLab CI/CD are essential for automating testing and deployment processes, ensuring applications are built, tested, and delivered with speed and reliability.

Maintaining Observability:

Monitoring and Alerting:

Prometheus and Grafana is a powerful duo that provides comprehensive monitoring capabilities. Prometheus scrapes applications for valuable metrics, while Grafana transforms this data into easy-to-understand visualizations for troubleshooting and performance analysis.

All-in-one Monitoring Solutions:

Tools like New Relic and Datadog offer a broader feature set, including application performance monitoring (APM), log management, and real-time analytics. These platforms help teams to identify and resolve issues before they impact users proactively.

Site Reliability Tools To Ensure High Availability and Scalability:

Container Orchestration:

Kubernetes orchestrates and manages container deployments, guaranteeing high availability and seamless scaling for your applications.

Log Management and Analysis:

The ELK Stack (Elasticsearch, Logstash, Kibana) is the go-to tool for log aggregation and analysis. It provides valuable insights into system behavior and performance, allowing teams to maintain consistent and reliable operations.

Managing Infrastructure

Secret Management:

HashiCorp Vault protects secretes, centralizes, and manages sensitive data like passwords and API keys, ensuring security and compliance within your infrastructure.

Cloud Resource Management:

Tools like AWS CloudFormation and Azure Resource Manager streamline cloud deployments. They automate the creation and management of cloud resources, keeping your infrastructure scalable, secure, and easy to manage. These tools collectively ensure that platform engineering can handle automation scripts, monitor applications, maintain site reliability, and manage infrastructure smoothly.

The Future is AI-Powered:

The platform engineering landscape is constantly evolving, and AI is rapidly transforming how we build and manage software delivery pipelines. The tools like Terraform, Kubecost, Jenkins X, and New Relic AI facilitate AI capabilities like:

  • Enhance security
  • Predict infrastructure requirements
  • Optimize resource security 
  • Predictive maintenance
  • Optimize monitoring process and cost

Conclusion

Platform engineering is becoming the cornerstone of modern software development. Gartner estimates that by 2026, 80% of development companies will have internal platform services and teams to improve development efficiency. This surge underscores the critical role platform engineering plays in accelerating software delivery and gaining a competitive edge.

With a strong foundation in platform engineering, organizations can achieve greater agility, scalability, and efficiency in the ever-changing software landscape. Are you ready to embark on your platform engineering journey?

Building a robust platform requires careful planning, collaboration, and a deep understanding of your team’s needs. At Mantra Labs, we can help you accelerate your software delivery. Connect with us to know more. 

Cancel

Knowledge thats worth delivered in your inbox

Loading More Posts ...
Go Top
ml floating chatbot