There are very few publications dealing with the details of filter calculation for use on actual SLMs where the information from several spectral data pixels is required to be combined in some way to produce a single binary phase value for each mirror. Of note, Flannery et al have performed a most extensive study into the application of binary phase-only correlation to machine vision [45]. Experimental work was performed with the 48×48 magneto-optic SLM, described in chapter four, and computer simulations using a 128×128 data array. To match the size of SLM transmissive element with the scale of the FFT, a 3×3 sub-array was averaged to produce a single complex number, the phase of which was used as input to a phase binarisation algorithm, actually that of Horner et al (see following subsection). The filter calculation process of this project combines several published phase binarisation algorithms to form a new binarisation procedure applicable to pixellated spatial filters. Briefly, the algorithms used in this project shall now be described.
| (1) |
| (2) |

Figure 8.1 illustrates what is referred to by Downie et al as the `threshold decision line' [68], defined by angle b, and table 8.1 lists the threshold angle b which is proposed by three different `camps', those of Horner et al [33], Psaltis et al [69] and Cottrell et al [70].
| Binarisation | b | Phase Angles ® 0 |
| HORNER et al | 0 | 0 £ q £ p |
| PSALTIS et al | [(p)/2] | -[(p)/2] £ q £ [(+p)/2] |
| COTTRELL et al | [(p)/4] | -[(3p)/4] £ q £ [(+p)/4] |
All three algorithms have been well documented and, as shall be described shortly, are used as substages to a new procedure developed in this thesis. A concise review of these algorithms may be found in an article by Dickey, Stalker and Mason [50].
|
|
In selecting a threshold angle of b = 0, the filter of Horner et al is effectively matched to the odd part of the object function. By this, it is meant that a similar target object would produce the exact same binary phase filter if the real parts of both object functions were identical. Psaltis et al, with b = [(p)/2], choose to match their filter with the even part of the object function. Both these filters then may suffer from false correlations with input objects having similar even and odd parts respectively, as analysed by Barnes et al [71]. The binarisation algorithm of Cottrell et al, with b = [(p)/4], attempts to combine information from both the EVEN and ODD parts of the object function to decide the final binarised filter phase, and indeed has been shown to reduce false correlations in simulations.
Downie et al [68] have performed an optimisation procedure on correlations which use a 2-D binary image of the NASA space shuttle as an input object, a function which in this case was largely EVEN. Experimental results were obtained using 128×128 magneto-optic SLMs as both input and spatial filter. Of interest to this chapter, they found that while in general an off-centre shift in the shuttle (making the object function more ODD) moved the optimally calculated threshold angle away from [(p)/2], the change in correlation peak intensity differed only marginally from the b = [(p)/2] correlation. In fact, the conclusion drawn from there study was that the b = [(p)/2] threshold angle is `near optimum for BPOFs for most object functions.' This observation shall be returned to in the next section. However, optimisation procedures are mentioned only for completeness and do not take any further part in the work of this chapter, save for the observation just made.
For the moment, let the choices open to us at each stage of the filter calculation be stated without questioning exactly why one might perform some actions.
In the calculation of the characteristic phase, one would like to give more emphasis to those spectral points containing most energy. For instance, if out of two spectral data points on a mirror one contains 106 more energy than the other, should one value the phase contributions from each pixel equally ? In computational determination of the characteristic phase, for instance, the FORTRAN function `ATAN2' determines the phase of a complex number irrespective of the magnitude of that number. Therefore if only one `bright' data pixel truly represented the object spectrum over that mirror the phase of this pixel should be given higher priority in determination of the characteristic phase. Thresholding of the initial spectrum to eliminate very low amplitude spatial frequencies could be performed although a mirror dependent threshold algorithm would possibly be required to counter the fact that mirrors in the high spatial frequency region of the spectrum generally receive less energy than those closer to the zero frequency. Thresholding was not used in this project for this reason. To begin with, two rather straightforward methods of determining Fc are now described.
| (6) |
| (7) |
Figure 8.2 plots the results of simulations using such a simple phase averaging. Note that the Psaltis final binarisation stage does not appear as filters using this final algorithm were found to be spatially invariant. The ordinate plots percentage peak energy and the abscissa the Gaussian parameter s (Chapter seven) which best befits description of the data by a 2-D Gaussian function (smaller s means a sharper peak). The ordinate is identical with the practical definition of optical efficiency hP given in chapter seven.

It is observed that neither the optical efficiency (percentage energy in peak) nor peak sharpness are particularly inspiring, the reason being the extreme simplicity of the filter algorithm. It will be shown later in this chapter that the phase information of the target objects used is approximated very well by a uniform distribution on the range -p to +p. If, over each mirror, the intensity does not vary rapidly then a large degree of cancellation occurs in equation 8.7 so that the distribution of Fc over the 15×15 mirror array is confined to a rather narrow region about Fc=0. Consequently, although the final binarisation algorithm of Horner et al will bisect this spread (and Cottrel et al if the distribution is wide enough), the algorithm of Psaltis et al will not. This explains the spatial invariance found in computer simulations of such simple filters using the Psaltis algorithm as a final binarisation stage.
Further, consider the case of a high intensity data point which has a phase of zero. In such a case this point will not contribute anything to the intensity average and thus highlights the limitations of equation 8.7 as a means of determination of characteristic phase. As the characteristic phase was formed by such a simple procedure these results are not of a high standard but are included for comparison with more sophisticated algorithms of this chapter, of which coherent summation is next to be described.

This technique enables rapid, straightforward filter calculation and has been used by Flannery et al with the 48×48 magneto-optic SLM. In their calculations a 3×3 sub-array of the DFT was coherently summed and the binarisation algorithm of Horner et al used to obtained the final SLM phases Fm. In fitting this process within the framework of general filter calculation, one would say that

Applying a voltage to a mirror, it may be recalled, decreases the optical path length through the liquid crystal as ne® no and no > ne. Therefore the light from an `ON' mirror (higher applied voltage) is spatially advanced relative to an `OFF' mirror. However, when viewed in amplitude modulation mode a mirror with a higher voltage appears darker (optical OFF state) and so mirrors shown dark in the above figure have are spatially advanced by [(l)/2] relative to mirrors shown as white.
In the next section, simulation and experimental autocorrelation results obtained from filters produced by two different techniques are compared. The first technique is that of coherent summation just described. The second technique goes under the title of the `combined' technique, whereby both initial and final data binarisation stages are carried out. Determination of the characteristic phase in the `combined' technique is by intensity weighted averaging of the (binarised) initial phases. This more general technique is under investigation in this thesis and the results obtained with coherent summation filters are used as a benchmark for comparison. A detailed analysis of `combined' filters is presented in the final section.
For comparison, figures 8.9 to 8.11 show the experimental auto-correlations obtained using combined algorithm generated filters. In each case the spectral data over each mirror was initially binarised by either the Horner, Psaltis or Cottrell algorithm, the characteristic phase was then formed by an intensity weighted average of the binarised phases2, and a final mirror phase is chosen by means of the Psaltis algorithm operating on the characteristic phase of each mirror.
A data thresholding operation has been performed to enhance each picture and offset the reduction in contrast which occurs during the hardcopy process. The thresholding operation in question is identical to that used by Hudson et al [73] and is depicted in figure 8.5.

Such operations have also been performed by Flannery et al [44] by optimisation of their video display controls where it is realised that basic post-processing of this kind will usually be required in experimental correlator systems. Appendix nine provides a comparison of the hardcopys obtained both with and without the thresholding operation.






Figure 8.12 plots the experimental correlation peaks arising from Horner, Psaltis and Cottrell initial binarisation, intensity weighted Fc and Psaltis final binarisation for the `C' target object. This object was chosen as it is neither the best nor the worst result and shows the clear central peak obtained from the algorithm expected to perform best, that of Psaltis initial binarisation, where no energy would lie were the image merely an inverted letter `C'.

Figure 8.13 shows scatter graphs of percentage peak energy to peak sharpness for every filter used in this project. Both simulation results and experimental results are displayed for convenient cross-comparison. The array camera field of view is equivalent to @ 1.7mm on a side so that the CCD array just picks out one replication4 of the correlation peak in the image plane (Recall the target objects are @ 1.9 mm on a side). Note that the areas used to collect the energy are therefore slightly different between simulation and experiment, but that this should cause no difficulty if it is remembered only to compare correlation peak characterisation parameters arising from different filters within the simulation results or the experimental results obtained, but not between the two.
Appendix nine provides an example of the fitted Gaussian over an auto-correlation peak so that the reader may judge the validity of s as a peak characterisation parameter.

A final analysis of the data is effected by performing a one-to-one comparison of the percentage peak energy between simulation and experiment, for each object, as shown in figure 8.14.

This method of data analysis is more direct than the scatter graph approach and, if the Horner data is not compared with the other binarisation algorithms, shows solid agreement for the combined technique between simulation and experiment. In all cases the Psaltis initial binarisation resulted in an equal or, more usually, brighter correlation peak than that of Cottrell initial binarisation. If one does choose to look at the results of Horner initial binarisation one can only say that both simulation and experiment agree the correlation resulting is extremely poor. Note again that this is not a reflection of the actual Horner algorithm merit, but arises from the nature of the combined process as previously detailed.
For coherent summation, in simulations the percentage peak energy for the object `I' is low, but comparable with the lowest Psaltis and Cottrell percentage peak energies of other target objects. The significantly lower peak energy of the `I' experimental results relative to the other target objects might suggest the actual fabricated object was somehow imperfect rather than an algorithmic weakness. For the intensity weighted Fc algorithm, simulations find the percentage peak energy lies approximately midway between the highest and lowest of all simulations (again discounting Horner initial binarisation) which again suggests the fabricated test object suffered some imperfection during manufacture due to the large experimental discrepancy relative to the other targets.
The results of coherent summation are again in strong agreement between simulation and experiment. In only one case, that of the `STAR' object, does the simulation actually predict that Cottrell final binarisation produces a brighter peak than that of Psaltis. Experimentally the Psaltis final binarisation is a clear winner for this object however. If one accepts the possibility that slight object scaling errors during manufacture, together with different random phase noise for each target object manufactured, may cause object dependent differences between simulation and experiment then this result should not cause too much concern. On the contrary, it is the degree to which simulation and experiment are in agreement which is the most significant result.

On the left of figure 8.15 is the autocorrelation of the square target object and on the right the cross-correlation with a letter `D'. The cross-correlation shows significant reduction in the replication intensities, even though they may only loosely be described as `peaks' in the auto-correlation. The front face reflection is clearly visible in both photographs. It was these photographs which prompted the Spatial Light Modulator research part of this project, and they are included to illustrate the potential improvement in this field by intensive algorithm research and improved device fabrication techniques.
A limited experimental investigation into the discrimination ability of the algorithms used on the 16×16 SLM was conducted. The best filter for the letter `A' (Psaltis initial and final binarisation and intensity weighted determination of the characteristic phase) was selected whilst the target object used was varied. Figure 8.16 depicts the intensity distributions in the image plane for the `B', `C' and `CND' target objects with image plane thresholding.

These results were typical of those generally obtained for which simulations show contain a percentage peak energy of at most 3%. Notice, however, that the arms of the `CND' symbol result in a strong cross-correlation with the letter `A' in figure 8.16.. Study into filter discrimination is in itself a substantial task and was was not pursued further in this project. The experimental results do, however, show that the filter algorithms chosen for use with the 16×16 SLM are both capable of generating both good object recognition characteristics and discrimination ability given the limited space-bandwidth product of the device.
It must be stressed that the analysis performed in this section relates only to binarisation algorithms which use 0 and p radians as the poles of the algorithm. The analysis presented is invalid should one choose poles such as -[(p)/2] and +[(p)/2] and therefore cannot be generalised to the case of general pole values. However, for the specific poles chosen (which are as valid as any) the analysis provides a detailed explanation of the filter characteristics and provides an explanation as to the differing performance of filters produced using the combined technique.
Over an arbitrary SLM mirror, let the subset of initial phase
information set to 0 be denoted as set `A', and those pixels set to
p radians be denoted as set `B'. The characteristic phase is most
readily formed by an intensity weighted average of the binarised initial
| (8) |
| (9) |
Therefore, if initial data binarisation is used followed by an intensity
weighted average of the (binarised) phases, one obtains a characteristic
phase which is linearly proportional to the percentage of initial data
set to p. Whatever the criteria used by the initial binarisation
algorithm to set phase to p, it might be argued that the
characteristic phase should reflect the results of this algorithm and, with
the procedure outlined here, just such a characteristic phase occurs.
Note that the approximation of a slowly varying intensity over the
mirror is a sufficient though not a necessary condition for replacing
Iij with a mean value. If, for instance, the intensity changes rapidly
over the mirror so that
| (10) |
This observation relies on the fact that the uniqueness of each object is related to the uniqueness of its associated phase spectrum, which may sound like stating the obvious. However, given that the phase spectra is unique to each object, it is a logical conclusion that if one were to pick the phase of an arbitrary spatial frequency of an arbitrary object it could lie anywhere on the range -p to +p i.e it is a random variable with a uniform probability distribution6.
If this is true, then any threshold angle b chosen for an initial data binarisation should set approximately half of the phases to 0 and half to p. Table 8.2 lists the percentage of Fij set to p radians for the SLM as a whole, for just two of the seven target objects used.
| Object | Initial Binarisation | %®p |
| A | Horner at al | 49.80% |
| Psaltis et al | 49.86% | |
| Cottrell et al | 49.82% | |
| C | Horner et al | 49.80% |
| Psaltis et al | 49.79% | |
| Cottrell at al | 49.76% |
In fact, every target object showed identical results to those of this table. Percentages are always on the lower side of 50% due to a programming decision which maps all phases which actually lie on the threshold line to a phase of zero. Based on the results such as those of table 8.2, the assumption of a rather uniform distribution of Fij would seem valid for the target objects used in this project and valid in general for almost every (non-symmetric) target object likely to be used in a realistic correlator. The conclusion is therefore that nB is most unlikely to be zero for all practical target objects.
In relation to the problem at hand, both sets A and B contain
approximately half of the total number of data pixels over any one mirror
which leads to the result that
| (11) |

The threshold lines of Horner et al and Cottrell et al have all characteristic phases lying in just one of their two distinguishable regions and thus would produce filters where Fm does not vary from mirror to mirror, as has been verified to occur in simulations carried out for this project. To recap on the filter formation process then,
Table 8.3 shows the extent to which this explanation is plausible by listing the percentages of mirrors which have a final phase Fm set to p.
| Initial Binarisation | A | B | C | CND | H | I | STAR |
| Horner et al | 58.7 | 48.4 | 48.8 | 47.3 | 48.0 | 49.2 | 47.3 |
| Psaltis et al | 49.2 | 44.4 | 54.3 | 45.7 | 43.4 | 41.4 | 51.6 |
| Cottrell et al | 48.8 | 50.0 | 49.6 | 49.6 | 48.6 | 43.8 | 49.2 |
So far, no criterion has been established to predict how well each filter will perform as a binary phase-only filter for optical correlation work. It is the analysis of filter symmetry which provides clues as to filter performance, as shall now be shown.

Recall that set B denotes those points which are mapped to a phase of p (and is used in determining Fc), and set A those points mapped to a phase of 0. Table 8.4 defines these sets for the three binarisation algorithms of this chapter for both M and M*, taking the phases shown in the figure for example.
| Binarisation Algorithm | Mirror M | Mirror M* | ||
| Set A | Set B | Set A | Set B | |
| Horner et al | 1,4 | 2,3 | 2,3 | 1,4 |
| Psaltis et al | 1,2 | 3,4 | 1,2 | 3,4 |
| Cottrell et al | 1,2,3 | 4 | 1,2,4 | 3 |
It is not immediately apparent that the fact that mutually exclusive data sets
are used for conjugate mirrors results in an filter which is completely
anti-symmetric. For mirror M, the characteristic phase is found from
| (12) |
| (13) |
| (14) |
| (15) |
From earlier work it is known that Fc(M) is closely distributed
about [(p)/2] so that if one writes
| (16) |
| (17) |

twice per cycle of the lens cut-off frequency. As such, one might expect the filter to be neither completely symmetric nor completely anti-symmetric after the final Psaltis binarisation algorithm is applied to the characteristic phases. Further, if the filter resulting from Horner initial binarisation is suspected to give poor results, and that arising from Psaltis initial binarisation rather better results, one might expect the filter in question to lie in between these two extremes in terms of correlation quality.
It should be noted that expectations expounded here of filter performance are based solely on the dependence of Fc on the choice of data sets used in its calculation. However, the approximations and reasoning used so far have led to an in depth analysis of filter symmetry expected to occur from the filter creation process framework at the beginning of this section. Figure 8.20 shows several filters calculated using this combined algorithm technique, these being typical of the results obtained for all test objects used. For the `star' target object the filter pattern is also shown as it appears on the 16×16 SLM, in amplitude mode. Remember that the top row and left column are not required for symmetric placing of the SLM in the frequency plane, and should be excluded from visual estimations of symmetry. The same mirror phase calculation is performed for these mirrors (from a reduced data set) nonetheless. Note the similarity between these filters and those as calculated by coherent summation.

One must recall a result of the `central limit theorem', which
states that if a large population has mean mp and standard deviation
sp then the mean of a set of sample populations of size n is
follows a Gaussian distribution with mean mp and standard
deviation ss given by
| (18) |

The `Combined Technique' devised in this project has been shown in computer simulations to produce slightly better auto-correlations than the technique of coherent summation, although there is little to choose between the two experimentally. Although a complete analysis of the CA technique has been performed, it is not the intention of this thesis to propose that this replace the procedure of coherent summation in auto-correlation work. Indeed, the CA technique has been the result of allowing complete freedom of choice in the overall framework of filter computation and it is remarkable that such an effective algorithm should have arisen from this.
In summary, it has been found that the Psaltis final binarisation algorithm applied to coherently summed spectral data over each mirror produces the best auto-correlation results (as judged by peak sharpness and peak energy) for the coherent summation filters. This is in agreement with the results of Downie et al [68] described in section 8.1.8. It is also found that if one initially binarises the spectral phase data according to the Psaltis algorithm, performs an intensity weighted average of these binarised phases to obtain a characteristic phase Fc for each mirror, and finally binarises Fc again according to Psaltis, one obtains a filter at least as good, if not better, as that obtained by coherent summation. The auto-correlations depicted in figures 8.7 and 8.10 show the results of the two best filter computation algorithms.
1 In the summer of 1991 the experimental results of this chapter were presented at the annual conference of the Society of Photo-Instrumentation Engineers, San Diego, California. The corresponding paper was based on an unpublished paper by Ranshaw but all experimental procedures and results are due to the author of this thesis. The paper, entitled `Optical correlation using a phase-only liquid crystal over silicon spatial light modulator', may be found towards the end of this thesis.
2A detailed analysis of the combined algorithm technique follows the experimental results of this chapter.
3Filters are termed equivalent if they share the same binarisation algorithm, whether it be used as an initial stage (intensity weighted Fc) or final stage (coherent summation).
4The replication chosen was the first one off-axis to avoid the glare from the front-face reflection of the SLM which produced a constant intensity inverted image of the object.
5The `B' object is an exception to this however.
6 A symmetric object function will, however, have an entirely REAL Fourier Transform and as such the phases Fij over any particular mirror must be either 0 or p (cos(Fij)=±1 when Fij is 0 or p.) However, the Fourier synthesis of an arbitrary input function will generally require a much wider distribution of spatial frequency offsets (phase) than this and, with the exception of symmetric functions and several physically unlikely target object functions, may be approximated as a uniformly distributed random variable on the range -p,+p.
7This
will not be true for objects exhibiting a high degree of symmetry however.