Docker Birmingham – November 2019

Yesterday evening I went to the Docker Birmingham meetup, sponsored by Black Cat Technology Solutions.

This event was a single longer session by Matt Todd called “Make Data Science Great Again (Part 2)” I didn’t see part 1, but he gave a summary, so that wasn’t too much of a problem.

Matt started off by introducing the scientific method and discussed reducing variables when testing, so you know the impact of a change. The suggestion being that development and data science should be the same. What better way to reduce variables than to package up a data science lab to make sure everyone is working on the same thing, so there is no/less variability between researchers, and they can focus on their work, not piecing together the kit.

He then went on to discuss Cloud Native Application Bundles (CNAB), and how they can be used to more reliably package multi-container applications, guaranteeing dependencies to a level greater than that possible by using Docker Compose alone. As an example he demoed his Digital Scientists Lab, which is a CNAB bundle containing a bunch of common kit used by data scientists (Jupyter, Spark, Flink, Kafka, RabbitMQ, Nifi, Elastic Stack etc.), which he could in theory give to several people to run experiments. It’s just his playground, but it gives you an idea of what’s possible. Using Nifi to link stuff together looked cool!

I started to make a few mental connections when he discussed the relationship to experimental data, because I look after the infrastructure for a research publishing system, and being able to keep not only the published research, but also the experimental data and potentially a way to reproduce the research findings is pretty important. It keeps those academics honest, if you know what I mean. It’s funny how just a few links to something you know a little bit about, and other stuff starts falling into place.

It was all a bit mind-blowing, but in a good way. I’m still only scratching the surface of this stuff, but it’s really good to see what else is going on in this space. I’ve added a few more things to my list of things to play around with.

It’s a couple of months until the next event, but there’s a CNCF event next month, so watch out for that!

Thanks to the folks at Black Cat Technology Solutions for sponsoring and organising the event, and to the Matt Todd for doing a great session. See you soon!

Cheers

Tim…

Midlands Microsoft 365 and Azure User Group – November 2019

Last night I went to the Midlands Microsoft 365 and Azure User Group. It was co-organised by Urfaan Azhar and Lee Thatcher from Pure Technology Group, and Adrian Newton from my company.

This event was focused on Microsoft Teams, which is the MS version of Slack. If you don’t know what Slack is, you probably need to come out from under that rock…

First up was Matt Fooks speaking about “Microsoft Teams, the death of email!” We use Teams at work, but I’m a bit of a noob at it and I don’t get involved in any of the administration side of things. The session started with an overview of what Teams does and how it is organised. We spent some time speaking about culture related stuff, which may well be a bigger factor than the tech side of things with regards to transitioning from email to Teams (or Slack) as the primary communication channel. In addition to security and organisational stuff, there was a discussion of integration and applications available from Teams. The first session ended with Urfaan Azhar discussing some of the recent innovations in Teams, covered here.

After food and drinks it was Kevin McDonnell with “Using Bots in Azure/Teams for Automation”. Following the theme of the event, this was a remote presentation over Teams. 🙂 An interesting point raised at the start was how social functionality can help drive adoption and engagement in the company. As an example he showed a daily challenge bot, which allowed people to guess the location of today’s Bing image. It’s not “work”, but it got people engaged in the product and communicating. Amongst other things, there was a quick demo of Power Automate, the new name for Flow, which now has RPA functionality in preview. There was also a demo of Bot Framework Composer, which looks like a pretty easy way to generate the basics of a bot from a simple designer. There was also a mention of Virtual Agents for creating conversational bots (chat bots), which looked pretty cool.

As I’ve said before, I’m not involved in the administration of M365, Azure and Teams, but this is all about context and possibilities for me. My company has some of these products, so it’s good to know what they can do, and maybe take advantage of some of them from some of the stuff I do have a hand in.

Thanks to everyone who turned up to support the event, the speakers, and the sponsor Pure Technology Group. See you at the next event.

Cheers

Tim…

Midlands Microsoft 365 and Azure User Group – October 2019

On Tuesday evening I went to the second event of the Midlands Microsoft 365 and Azure User Group. It was co-organised by Urfaan Azhar and Lee Thatcher from Pure Technology Group, and Adrian Newton from my company.

First up was Matt Fooks speaking about security in M365 and Azure. He did an overview and demos of a number of security features, giving an idea of their scope, how easy/hard they were to configure and importantly what licenses they were covered by. Some of this was a bit over my head, but for me it’s about understanding possibilities and what’s available, even if I wouldn’t have a clue what to do with it. Other people in the company do that stuff. At one point I leaned over to one of my colleagues and said, “Could we use that for…”, and he came back with, “Yeah. We’ve done a POC with that. Look!”, then showing me an example of it working with one of our services. 🙂

After food and drinks it was Urfaan Azhar speaking about Azure pricing, and working through an example with the Azure Pricing Calculator. I’ve been using AWS for a few years, so when I have questions I tend to use AWS terminology, which I’m sure can be annoying, but I’ve not learned the new language yet. As I expected, it’s “the same but different”. 🙂

Both guys were keen to point out that just doing a lift & shift from on-prem to cloud using infrastructure as a service (IaaS) isn’t what you should be aiming for. The real value comes from using platforms. My feelings exactly! If I just put what I have now into the cloud, it’s just other people’s servers. I’m more interested in what I can offload to give me more time to do other things, and to stop me screwing up on the daily because I’m to busy to do “the basics”…

Thanks to everyone who turned up to support the event, the speakers, and the sponsor Pure Technology Group. See you at next month’s event.

Cheers

Tim…

Docker Birmingham – September

Yesterday evening I went to my first Docker Birmingham meetup, sponsored by Black Cat Technology Solutions.

I was so tired before the event I was really nervous I would fall asleep half way through a presentation and start snoring. 🙂 When I got there I was greeted by an array of pizzas. I wanted to eat them so badly, but then I would definitely sleep, so I resisted. 🙂 I spent a bit of time chatting to one of the hosts Shaun McLernon before the sessions started.

The agenda had a last minute change, as one of the speakers was ill, so the first presentation was a lighthearted one by Alistair Hey called “CV Driven Development – Why it’s ok not to be ‘cool’. ” He spoke about the things that trigger alarm bells when he’s looking at CVs, and used that as a segway into comparing what’s cool, with what just works. A specific case being a comparison between Kubernetes and AWS ECS, where he compared the pros and cons of each. The take home message was use the correct tool for the job, where the “correct tool” choice will be influenced by your requirements, skills and what works for your organisation.

Being short of a speaker, a couple of folks stepped up to talk about their projects in a lightning talk style. First up was Marcus Oaten with a talk about an environment built on Docker for testing new architectures for a Drupal application. Essentially using Docker to model all the services and layers to try new approaches out before having to commit to a specific architectural change.

Next up was Dan Webb speaking about the evolution of the builds used for a PHP environment he was working on. Moving from large-ish multi-purpose containers to smaller single-purpose containers with separation of duties and multi-stage builds.

I think the lightning talks worked really well. They triggered a lot of discussion, with people throwing out ideas.

The meetup was really useful. I like the “this is what we are doing” stuff, as it feels a lot more real, and shows the thought process and progression. I’m not sure about the experience level of the other folks, but I’m a Docker newbie, so this sort of thing is more important to me than hearing all about the super-cool stuff I will probably never use. I like hearing that as well, but this this stuff is more relevant to me at this stage.

I definitely plan to go again. Thanks to the folks at Black Cat Technology Solutions for sponsoring and organising the event, and to the speakers for stepping up to the plate.

Cheers

Tim…

Midlands Microsoft 365 and Azure User Group – Launch

Last night I went to the launch of a new meetup called Midlands Microsoft 365 and Azure User Group. It was co-organised by Urfaan Azhar and Lee Thatcher from Pure Technology Group, and Adrian Newton and Mark Smith from my company.

Some of you may have noticed this isn’t about Oracle. Yes we have a big Oracle Cloud Apps thing and a bunch of Oracle on-prem stuff, but we also have a lot of Microsoft stuff here, including loads of mailboxes on Office 365 etc. As a result, Azure is also becoming a big thing for us.

I’ve used Azure a bit for some Oracle trials, with the articles on the site, and I did a WebLogic on Azure talk some years back, but this is pretty far out of my lane, so I was really there to show some support to our folks and trying to learn some stuff. 🙂

The turnout was really good. I think there were about 40 people in total, with about 6 coming from our company. For the first event I was kind-of expecting more of “us”, and less of “not us”, so the fact so many “not us” turned up was awesome! Getting a couple of Microsoft Most Valuable Professisonal (MVP) speakers for the launch event was cool.

After some introductions from Urfan and Lee, the first speaker was Ed Baker with an “Introduction to Microsoft 365”. The purpose of this session was for Ed to give an overview of the M365 stack and try to gauge what we were interested in, to see how the meetup should move forward in future. Ed is an Enterprise Mobility MVP and is clearly comfortable in front of an audience.

After food (Pizza and Indian) and drinks it was time for Gareth Jones with “An Introduction to Microsoft Azure”. Gareth talked about the way Microsoft deliver the Azure services, including the setup of their data centres. Once again, this was about gauging the interest for the different aspects of Azure. Gareth is an Azure MVP, and just like Ed was very happy in front of a crowd.

It was a really good start for the new meetup. Big thanks to Urfaan, Lee, Adrian and Mark for getting this going. Thanks to Ed and Gareth for taking the time to come and speak to us. Thanks to everyone who turned up to support the event, as well as the sponsor Pure Technology Group. I look forward to the next event, to see how this moves forward!

Cheers

Tim…

Birmingham Digital & DevOps Meetup : August 2019

Yesterday evening I went along to the Birmingham Digital & DevOps Meetup for the first time. It followed the usual meetup format of quick intro, talk, break, talk then home.

First up was Elton Stoneman from Docker with “Just What Is A “Service Mesh”, And If I Get One Will It Make Everything OK?” The session started by describing the problems associated with communication between the building blocks of a system, and how a service mesh can alleviate some of them. It then moved on to some service mesh demos using Istio. These included examples of altering the routing of traffic to do canary testing and targeting specific groups etc.

Elton was really honest about the learning curve, issues and overhead associated with this sort of setup. One comment I really liked was when he showed a slide containing the following, saying that often people assume there is a progression from left to right.

Meaning people assume you learn Docker, then you need some form of orchestration so you learn Swarm. From there you naturally progress to Kubernetes and once you understand that, you will inevitably move on to a service mesh using something like Istio. Elton’s point was you don’t *have to* continue on this progression. You can step off at any point once you’ve achieved the functionality you need. I think this is a really important point and I can see it reflected in what I do with Docker. We’ve got some things that stop at just using Docker containers, with no orchestration at all. I work on a project that requires some orchestration, so we use Swarm, which is really easy to use. So far I’ve had no reason to go beyond Swarm, and even considering a service mesh is so far down the line for us. I’m not discounting the relevance of these for everyone, but they don’t make sense for me at this point.

It was a really good session and I learned a lot. You can check out Elton’s blog here.

After the break it was James Relph with “Container Security Fundamentals”. This started of with a basic introduction to containers, using that as an entry point to explain how containers can be problematic from a security perspective, and what you can do to reduce the impact. He covered a lot of stuff, some of which I already do, some I know about and some stuff that was new to me. This is not an exhaustive list.

  • Don’t automatically trust images from Docker hub. Do your due diligence, even when they are from a reputable source.
  • Use your own image repository. He mentioned ECR amongst others. This can be used for your own images, but also base images from Docker Hub, which you have verified.
  • Don’t use “latest”, but use specific tagged versions. Latest gives you all the latest fixes, but all the latest bugs too. You should test and verify before you let images out into your infrastructure.
  • Multi-stage builds to reduce the size of containers and minimise the attack surface. Basically, copy out what you need and leave the crap behind.
  • Using sidecar containers to provide specific services, allowing your application images to remain more focused. The sidecar images can be maintained by feature experts to make sure they are as secure as possible.
  • Scanning images using Clair, amongst other things, to check for dodgy software. One of the audience mentioned Anchore.
  • Using microVMs like Firecracker to provide additional isolation, whilst retaining the ease of use of containers. I’ve not played with this, but I have tried Kata Containers, which seems to do pretty much the same.

There was a lot in there!

I was a bit nervous going into the event thinking it would all go over my head, and some of it probably did, but it was cool. I got to speak to a few people before the event, during the break and at the end. It seemed like there were quite a mix of people there from beginners in these areas upward, so I didn’t feel out of place.

A few times I found myself thinking, that’s great, but what do I do about my 3rd party applications? I’ve written before (here) about how 3rd party apps screw everything up. 🙂

Thanks to Elton Stoneman and James Relph for taking the time to come and speak to us. Thanks to the folks from BrumDigitalDevOps for organising the event, and to Capgemini UK for sponsoring the event.

Cheers

Tim…

Paris Province Oracle Meetup

paris-province-oracle-meetupThe reason for me being in Paris was to speak at the Paris Province Oracle Meetup. Breaking my journey to the Netherlands with a quick trip to Paris was a really easy way to connect with more people.

The Paris meetup is very similar to those found in other cities around the world, including Oracle Midlands in my home town. We all gathered at about 19:00 in the AVNET office in Paris and I did two talks with a short break between them. The first talk was about pluggable databases and the second one was about running Oracle databases in the cloud.

I like these local meetups. They feel a lot less formal and more personal than some (but not all) conferences. It just feels more natural to me. I really enjoyed doing the talks and the crowd seemed to respond well to them, which was nice. I’ll definitely be back again, if they will have me. Maybe next time I will get to do some sightseeing in Paris too. 🙂

The meetup finished at about 21:45 and Stew Aston took me out to get some food. We chatted for ages about life, the Universe and Oracle. 🙂 Once the food was over, he gave me a lift back to my hotel and by the time I got into bed it was about 01:00.

Big thanks for Yves for inviting me across to the event, and thank you to everyone who came out to support the event. Without you it can’t happen. Also thanks go out to the Oracle ACE Program for continuing to let me fly the flag. 🙂

So that’s paris done in less than 24 hours. Next stop the Netherlands!

Cheers

Tim…