Watching for source changes

Develop a Kubernetes controller that reacts to source changes.

In this guide you’ll be developing a Kubernetes controller with Kubebuilder that subscribes to GitRepository events and reacts to revision changes by downloading the artifact produced by source-controller.


On your dev machine install the following tools:

  • go >= 1.19
  • kubebuilder >= 3.0
  • kind >= 0.8
  • kubectl >= 1.21

Install Flux

Install the Flux CLI with Homebrew on macOS or Linux:

brew install fluxcd/tap/flux

Create a cluster for testing:

kind create cluster --name dev

Verify that your dev machine satisfies the prerequisites with:

flux check --pre

Install source-controller on the dev cluster:

flux install \
--namespace=flux-system \
--network-policy=false \

Clone the sample controller

You’ll be using fluxcd/source-watcher as a template for developing your own controller. The source-watcher was scaffolded with kubebuilder init.

Clone the source-watcher repository:

git clone
cd source-watcher

Build the controller:


Run the controller

Port forward to source-controller artifacts server:

kubectl -n flux-system port-forward svc/source-controller 8181:80

Export the local address as SOURCE_CONTROLLER_LOCALHOST:


Run source-watcher locally:

make run

Create a Git source:

flux create source git test \
--url= \
--ignore-paths='/*,!/manifests' \

The source-watcher will log the revision:

New revision detected   {"gitrepository": "flux-system/test", "revision": "v0.34.0/90f0d81532f6ea76c30974267956c7eaee5c1dea"}
Processing manifests...

Change the Git tag:

flux create source git test \
--url= \
--ignore-paths='/*,!/manifests' \

And source-watcher will log the new revision:

New revision detected   {"gitrepository": "flux-system/test", "revision": "v0.35.0/1bf63a94c22d1b9b7ccf92f66a1a34a74bd72fca"}

The source-controller reports the revision under GitRepository.Status.Artifact.Revision in the format: <branch|tag>/<commit>.

How it works

The GitRepositoryWatcher controller does the following:

  • subscribes to GitRepository events
  • detects when the Git revision changes
  • downloads and extracts the source artifact
  • writes the extracted dir names to stdout
type GitRepositoryWatcher struct {
	HttpRetry       int
	artifactFetcher *fetch.ArchiveFetcher

func (r *GitRepositoryWatcher) SetupWithManager(mgr ctrl.Manager) error {
	r.artifactFetcher = fetch.NewArchiveFetcher(

	return ctrl.NewControllerManagedBy(mgr).
		For(&sourcev1.GitRepository{}, builder.WithPredicates(GitRepositoryRevisionChangePredicate{})).


func (r *GitRepositoryWatcher) Reconcile(ctx context.Context, req ctrl.Request) (ctrl.Result, error) {
	log := ctrl.LoggerFrom(ctx)

	// get source object
	var repository sourcev1.GitRepository
	if err := r.Get(ctx, req.NamespacedName, &repository); err != nil {
		return ctrl.Result{}, client.IgnoreNotFound(err)

	artifact := repository.Status.Artifact
	log.Info("New revision detected", "revision", artifact.Revision)

	// create tmp dir
	tmpDir, err := os.MkdirTemp("", repository.Name)
	if err != nil {
		return ctrl.Result{}, fmt.Errorf("failed to create temp dir, error: %w", err)
	defer os.RemoveAll(tmpDir)

	// download and extract artifact
	if err := r.artifactFetcher.Fetch(artifact.URL, artifact.Checksum, tmpDir); err != nil {
		log.Error(err, "unable to fetch artifact")
		return ctrl.Result{}, err

	// list artifact content
	files, err := os.ReadDir(tmpDir)
	if err != nil {
		return ctrl.Result{}, fmt.Errorf("failed to list files, error: %w", err)

	// do something with the artifact content
	for _, f := range files {
		log.Info("Processing " + f.Name())

	return ctrl.Result{}, nil

To add the watcher to an existing project, copy the controller and the revision change predicate to your controllers dir:

In your main.go init function, register the Source API schema:

import (
	utilruntime ""
	clientgoscheme ""

	sourcev1 ""

func init() {

	// +kubebuilder:scaffold:scheme

Start the controller in the main function:

func main()  {

	if err = (&controllers.GitRepositoryWatcher{
		Client:    mgr.GetClient(),
		HttpRetry: httpRetry,
	}).SetupWithManager(mgr); err != nil {
		setupLog.Error(err, "unable to create controller", "controller", "GitRepositoryWatcher")


Note that the watcher depends on Flux runtime and Kubernetes controller-runtime:

require ( v0.20.0 v0.13.0

That’s it! Happy hacking!

Last modified 2022-10-11: Update source watcher guide (806f1ee)