Category Archives: Automation

Export PowerShell modules to be used offline

There could be a situation when PowerShell modules have to be used on machine without internet access so here’s quick instruction how to deal with “donor” and “donee” machines:

# "Donor" machine 
## Install "custom" module
Install-Module -Name Az -RequiredVersion 3.7.0 -Scope CurrentUser -Force

## Export "custom" module
Save-Module -Name Az -Path 'C:\Users\kag\Documents\ps_modules' -RequiredVersion 3.7.0 -Force

# "donee" machine
## Add custom path with "custom" modules to PSModulePath 
## ..AND keep only "system" path from defaults, 
##.. `C:\Users\user\Documents\WindowsPowerShell\Modules` and `C:\Program Files\WindowsPowerShell\Modules` 
## ..have to be removed in order to avoid conflicts between installed and "custom" modules
$env:PSModulePath = $env:PSModulePath + "C:\Users\kag\Documents\ps_modules;C:\Windows\system32\WindowsPowerShell\v1.0\Modules"

## Unblock all files because some dll's could be locked 
Get-ChildItem "C:\Users\kag\Documents\ps_modules\*" -Recurse | Unblock-File

## Import "custom" module and check that it's listed in usable but not installed list
Import-Module -name "C:\Users\kag\Documents\ps_modules\Az" -Verbose

## Check that module is ready to be used
Get-Module -Name Az

## Check that module isn't really installed
Get-InstalledModule -Name Az -AllVersions

 

AWS CloudFormation EC2 Win AD servers

Task

  1. EC2 instances must be automatically added to Active Directory (AD) on provisioning and removed form AD on termination
  2. Each EC2 instance must have 3 private IP addresses (required for MS SQL Always-On) assigned by DHCP
  3. NLB must be used to expose MS SQL Always-On Listener because it’s faster than changing CNAME value
  4. Dedicated ASG to keep each instance fault tolerant
  5. Dedicated data disks which are re-attached to new instance in ASG with the same disk letters

Solution

https://github.com/kagarlickij/aws-cloudformation-ec2-win-ad-servers

Continue reading

Cloud agnostic approach with Terraform

If you’ve been working with both AWS and Azure you should have noticed that each of them has some advantages.

Tools like Terraform might be very helpful if you’re not familiar with both CloudFormation and Azure RM.

However don’t consider Terraform as a nonpareil (this is not true at all), it is simple tool for simple tasks.

So in this  post I’ll tell you about Terraform terms and concepts and show example with AWS & Azure.

For a bit more complicated infrastructure you’ll have to use CloudFormation and Azure RM

Continue reading

How to query a few MS SQL databases on different servers from single script

It’s quite common practice to keep databases on dedicated servers nowdays, especially if you use AWS RDS or Azure.

Relational databases performance is always painful and you might want to split data across at least a few databases. But if data is divided you still to have to do some logical operations across the whole amount and it’s quite simple, so let me show how it can be done using bot SQL Server Management Studio and CLI.

Continue reading

Install single tableau server in custom AWS VPC

If you interested in Tableau installation on AWS you should have a look at CloudFormation templates from Tableau.

Single server installation suits well for trial, but it has a number of limitations including link to default VPC. But what if you want to deploy it in dedicated VPC or you don’t have default one?

Not a big deal, I’ve updated template and you can use it:

Continue reading

Install Microsoft sqlcmd command-line tools on AWS Linux

If you have MS SQL server in your environment and have to do some actions (execute migrations, change data, etc.) with it during your CI/CD it might be quite inconvenient to use Windows machine.

Fortunately we have sqlcmd for Linux, and Microsoft provides some instructions for popular Linux distributions –¬†https://docs.microsoft.com/en-us/sql/linux/sql-server-linux-setup-tools

But what if you have AWS Linux? If you try to use instructions from MS you will fail and there’s not much information across the Internet about this topic. The only useful link is here.

Since my env is highly automated I decided to create simple script to install sqlcmd on AWS Linux and share it with you:

Continue reading

Get active Jira sprint name from CLI

When you do some CI/CD jobs you might want to mark some builds with name of the current (active) Jira sprint.

We have a dozen components in the project with dedicated Jira projects and sprint names are like “Backend sprint 12”, so you probably don’t want to add useless information to the build and need only number to identify build.

Jira has a nice REST, so you can get what you want in a very simple way:

Continue reading